Properties to configure to establish a connection to S3 in your AWS
account.
Amazon S3 connection
Property |
Configuration |
|
---|---|---|
Selection | Select or enter Amazon S3. | |
Configuration | ||
Engine | Select your engine in the list. | |
Main | Specify credentials | Toggle this option OFF if your authentication type does not require credentials. By default, the authentication with credentials is enabled. |
AWS access key | Enter the Access Key ID that uniquely identifies your AWS Account. To know how to get your Access Key and Access Secret, read Getting Your AWS Access Keys. | |
AWS secret key | Enter the Secret Access key that uniquely identifies your AWS Account. To know how to get your Access Key and Access Secret, read Getting Your AWS Access Keys. | |
Use STS | Toggle this option ON to enable the AWS Security Token Service and
create a new assumed role session:
|
|
Description | Enter a display name (mandatory) and a description (optional) for the connection. |
Amazon S3 dataset
Property | Configuration | |
---|---|---|
Dataset name | Enter a display name for the dataset. This name will be used as a unique identifier of the dataset in all Talend Cloud apps. | |
Connection | Select your connection in the list. If you are creating a dataset based on an existing connection, this field is read-only. | |
S3 data | AWS bucket name | Select or enter the name of your Amazon S3 bucket. |
Object name | Select or enter the path of the object (file) to be retrieved. | |
Encrypt data at rest | Enable this option to enable data encryption and enter your KMS master key. | |
Format config | Auto detect | Click this button to automatically detect the format of the data to be retrieved. |
Format | Alternatively, select in the list the format of the file to be retrieved
and enter or select the information related to this file format:
|
Note: If you have a CSV dataset on S3
and want to use it with a Type Converter processor in your pipeline, you
need first to define a quote (") in the Text Enclosure Character field when creating the S3 dataset
otherwise an error will be thrown.