Retrieving files unloaded to Amazon S3 - 7.3

Amazon Redshift

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Amazon services (Integration) > Amazon Redshift components
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon Redshift components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon Redshift components
Last publication date
2024-02-21

Procedure

  1. Double-click tS3List to open its Basic settings view on the Component tab.
  2. Fill the Access Key and Secret Key fields with their corresponding context variables.
  3. From the Region list, select the AWS region where the unload files are created. In this example, it is US Standard.
  4. Clear the List all buckets objects check box, and click the [+] button under the table displayed to add one row.
    Fill in the Bucket name column with the name of the bucket in which the unload files are created. In this example, it is the context variable context.s3_bucket.
    Fill in the Key prefix column with the name prefix for the unload files. In this example, it is person_unload_.
  5. Double-click tS3Get to open its Basic settings view on the Component tab.
  6. Fill the Access Key field and Secret Key field with their corresponding context variables.
  7. From the Region list, select the AWS region where the unload files are created. In this example, it is US Standard.
  8. In the Bucket field, enter the name of the bucket in which the unload files are created. In this example, it is the context variable context.s3_bucket.
    In the Key field, enter the name of the unload files by pressing Ctrl + Space and from the list selecting the global variable ((String)globalMap.get("tS3List_1_CURRENT_KEY")).
  9. In the File field, enter the local path where the unload files are saved. In this example, it is "E:/Redshift/" + ((String)globalMap.get("tS3List_1_CURRENT_KEY")).