Retrieving files unloaded to Amazon S3 - 7.1

Amazon Redshift

author
Talend Documentation Team
EnrichVersion
Cloud
7.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Open Studio for MDM
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Amazon services (Integration) > Amazon Redshift components
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon Redshift components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon Redshift components
EnrichPlatform
Talend Studio

Procedure

  1. Double-click tS3List to open its Basic settings view on the Component tab.
  2. Fill the Access Key and Secret Key fields with their corresponding context variables.
  3. From the Region list, select the AWS region where the unload files are created. In this example, it is US Standard.
  4. Clear the List all buckets objects check box, and click the [+] button under the table displayed to add one row.
    Fill in the Bucket name column with the name of the bucket in which the unload files are created. In this example, it is the context variable context.s3_bucket.
    Fill in the Key prefix column with the name prefix for the unload files. In this example, it is person_unload_.
  5. Double-click tS3Get to open its Basic settings view on the Component tab.
  6. Fill the Access Key field and Secret Key field with their corresponding context variables.
  7. From the Region list, select the AWS region where the unload files are created. In this example, it is US Standard.
  8. In the Bucket field, enter the name of the bucket in which the unload files are created. In this example, it is the context variable context.s3_bucket.
    In the Key field, enter the name of the unload files by pressing Ctrl + Space and from the list selecting the global variable ((String)globalMap.get("tS3List_1_CURRENT_KEY")).
  9. In the File field, enter the local path where the unload files are saved. In this example, it is "E:/Redshift/" + ((String)globalMap.get("tS3List_1_CURRENT_KEY")).