Listing the instance groups in the Amazon EMR cluster - 7.0

Amazon EMR

author
Talend Documentation Team
EnrichVersion
7.0
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Open Studio for MDM
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Amazon services (Integration) > Amazon EMR components
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon EMR components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon EMR components
EnrichPlatform
Talend Studio
Configure the tAmazonEMRListInstances component and the tJava component to retrieve and display the ID and name information of all instance groups in a running cluster.

Procedure

  1. Double-click the tAmazonEMRListInstances component to open its Basic settings view.
  2. In the Access Key and Secret Key fields, enter the authentication credentials required to access Amazon S3.
  3. Select the AWS region from the Region drop-down list. In this example, it is Asia Pacific (Tokyo).
  4. Clear the Filter master and core instances check box to list all instance groups, including the Master, Core, and Task type instance groups.
  5. In the Cluster id field, enter the ID of the cluster for which to list the instance groups. In this example, the returned value of the global variable CLUSTER_FINAL_ID of the previous tAmazonEMRManage component is used.
  6. Double-click the tJava component to open its Basic settings view.
  7. In the Code field, enter the following code to print the ID and Name information of each instance group in the cluster.
    System.out.println("\r\n===== Instance Group =====");
    System.out.println("Instance Group ID:    " + (String)globalMap.get("tAmazonEMRListInstances_1_CURRENT_GROUP_ID"));
    System.out.println("Instance Group Name:  " + (String)globalMap.get("tAmazonEMRListInstances_1_CURRENT_GROUP_NAME"));