Setting up SSE KMS for your EMR cluster - 7.3

Amazon EMR distribution

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development > Designing Jobs > Hadoop distributions > Amazon EMR
Last publication date
2024-02-21
If required by the security policy of your organization, you need to set up SSE KMS, the server-side encryption service of Amazon, for the EMR cluster to be used, before creating this cluster.

About this task

This procedure explains only the SSE KMS related operations for getting started with the security configuration for EMR. If you need the complete information about all the available EMR security configurations provided by AWS, see Create a Security Configuration from the Amazon documentation.

Procedure

  1. If not yet done, go to https://console.aws.amazon.com/kms to create a customer managed CMK to be used by the SSE KMS service. For detailed instructions about how to do this, see this tutorial from the AWS documentation.
    • When adding roles, among other roles to be added depending on your security policy, you must add the EMR_EC2_DefaultRole role.

      The EMR_EC2_DefaultRole role allows your Jobs for Apache Spark to read or write files encrypted with SSE-KMS on S3.

      This role is a default AWS role that is automatically created along with the creation of your first EMR cluster. If this role and its associated policies do not exist in your account, see Use Default IAM Roles and Managed Policies from the AWS documentation

  2. On the Amazon EMR page of AWS, select the Security configurations tab and click Create to open the Create security configuration view.
  3. Select the At-rest encryption check box to enable SSE KMS.
  4. Under S3 data encryption, select SSE-KMS for Encryption mode and select the CMK key mentioned at the beginning of this procedure for AWS KMS Key.
  5. Under Local disk encryption, select AWS KMS for Key provider type and select the CMK key mentioned at the beginning of this procedure for AWS KMS Key.

    Example

  6. Click Create to validate your security configuration.
    In the real-world practice, you can also configure the other security options such as Kerberos and IAM roles for EMRFS before clicking this Create button.
  7. Click Clusters and once the Create Cluster page is open, click Go to advanced options to start creating the EMR cluster step by step.
  8. At the last step called Security, in the Authentication and encryption section, select the Security Configuration created in the previous steps.