Scenario: File exchanges with Amazon S3 - 6.1

Talend Components Reference Guide

EnrichVersion
6.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for Data Quality
Talend Open Studio for ESB
Talend Open Studio for MDM
Talend Real-Time Big Data Platform
task
Data Governance
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

In this scenario, tS3Put is used to send a file to the Amazon S3 server while tS3Get is used to get that file.

Linking the components

  1. Drop tS3Connection, tS3Put and tS3Get onto the workspace.

  2. Link tS3Connection to tS3Put using the OnSubjobOk trigger.

  3. Link tS3Put to tS3Get using the OnSubjobOk trigger.

Configuring the components

  1. Double-click tS3Connection to open its Basic settings view.

  2. In the Access Key and Secret Key fields, enter the authentication credentials.

  3. Double-click tS3Put to open its Basic settings view.

  4. Select the Use existing connection check box to reuse the connection.

  5. In the Bucket field, enter the bucket name.

  6. In the Key field, enter the name of the file to be saved on the S3 server.

  7. In the File field, enter the file to be uploaded to the S3 server.

  8. Double-click tS3Get to open its Basic settings view.

  9. Select the Use existing connection check box to reuse the connection.

  10. In the Bucket field, enter the bucket name.

  11. In the Key field, enter the name of the file to be retrieved from the S3 server.

  12. In the File field, enter the local name of the retrieved file.

Executing the Job

  1. Press Ctrl + S to save the Job.

  2. Press F6 to run the Job.

  3. Go to the S3 web console:

    As shown above, the file has been put on to the S3 server.

  4. Refresh the S3 Browser client:

    This shows that the S3 Put action was performed successfully.

  5. Go to the folder where the retrieved file is saved locally:

    As shown above, the remote file is retrieved to the local disk, proof that the S3 Get action was performed successfully.