tS3Copy Standard properties

Amazon S3

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Data Integration
Talend MDM Platform
Talend Real-Time Big Data Platform
Talend Data Management Platform
Talend Big Data
Talend Data Services Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Data Fabric
Talend Open Studio for MDM
Talend ESB
Talend Big Data Platform
Talend Open Studio for ESB
task
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon S3 components
Data Governance > Third-party systems > Amazon services (Integration) > Amazon S3 components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon S3 components
EnrichPlatform
Talend Studio

These properties are used to configure tS3Copy running in the Standard Job framework.

The Standard tS3Copy component belongs to the Cloud family.

The component in this framework is available in all Talend products.

Basic settings

Use an existing connection

Select this check box and in the Component List click the relevant connection component to reuse the connection details you already defined.

Access Key

Specify the Access Key ID that uniquely identifies an AWS Account. For how to get your Access Key and Access Secret, visit Getting Your AWS Access Keys.

Secret Key

Specify the Secret Access Key, constituting the security credentials in combination with the access Key.

To enter the secret key, click the [...] button next to the secret key field, and then in the pop-up dialog box enter the password between double quotes and click OK to save the settings.

Inherit credentials from AWS role

Select this check box to obtain AWS security credentials from Amazon EC2 instance metadata. To use this option, the Amazon EC2 instance must be started and your Job must be running on Amazon EC2. For more information, see Using an IAM Role to Grant Permissions to Applications Running on Amazon EC2 Instances.

Assume role

Select this check box and specify the values for the following parameters used to create a new assumed role session.
  • Role ARN: the Amazon Resource Name (ARN) of the role to assume.

  • Role session name: an identifier for the assumed role session.

  • Session duration (minutes): the duration (in minutes) for which we want to have the assumed role session to be active.

For more information on assuming roles, see AssumeRole.

Region

Specify the AWS region by selecting a region name from the list or entering a region between double quotation marks (e.g. "us-east-1") in the list. For more information about the AWS Region, see Regions and Endpoints.

Bucket

Specify the name of the source bucket that contains the object to be copied.

Key

Specify the key of the object to be copied.

Bucket

Specify the name of the destination bucket to which the object will be copied.

Key

Specify the new key for the object after being copied to the destination bucket.

Server-Side Encryption

Select this check box to enable server-side encryption to protect your data sent to Amazon S3 using Amazon S3-Managed Encryption Keys (SSE-S3).

For more information about server-side encryption with SSE-S3, see Protecting Data Using Server-Side Encryption with Amazon S3-Managed Encryption Keys (SSE-S3).

Die on error

Select this check box to stop the execution of the Job when an error occurs.

Clear the check box to skip any rows on error and complete the process for error-free rows.

Advanced settings

Config client

Select this check box and specify the client paramter(s) by clicking the [+] button to add as many rows as needed, each row for a client parameter, and then setting the value of the following fields for each parameter:

  • Client Parameter: click the cell and from the drop-down list displayed select the client parameter.

  • Value: enter the value for the selected parameter.

This check box is available only when the Use an existing connection check box is cleared.

Part size (Mb) for file larger than 5GB

Specify the part size in MB. This parameter takes effect only when you copy an Amazon S3 object that is larger than 5 GB through multiple parts.

Note that in the copy operation, the object's metadata may drop during transition.

STS Endpoint

Select this check box and in the field displayed, specify the AWS Security Token Service endpoint, for example, sts.amazonaws.com, where session credentials are retrieved from.

This check box is available only when the Assume role check box is selected.

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at the Job level as well as at each component level.

Global Variables

ERROR_MESSAGE

The error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is selected.

Usage

Usage rule

This component can be used as a standalone component.