Creating an Amazon S3 bucket

Amazon S3

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Open Studio for MDM
Talend Real-Time Big Data Platform
Talend Data Integration
Talend ESB
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Open Studio for Big Data
Talend Open Studio for ESB
Talend Data Services Platform
Talend Big Data
Talend MDM Platform
Talend Open Studio for Data Integration
task
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon S3 components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon S3 components
Data Governance > Third-party systems > Amazon services (Integration) > Amazon S3 components
EnrichPlatform
Talend Studio
The following instructions describe how to create an Amazon S3 bucket from a Standard Job in the Talend Studio.

Before you begin

As for any Amazon service, you will need your Amazon credentials. You can enter your credentials in the Access Key and Secret Key fields, or use context variables, as mentioned in the Amazon EMR - Getting Started article.

Procedure

  1. In a Standard Job, add a tS3Connection component and open the Component view.
  2. You may choose any resource location; however, we recommend not using the EU (Frankfurt) region:
  3. To check if a bucket already exists, you can use the tS3BucketExist component. Add a tS3BucketExist component and connect it to the tS3Connection component with an OnComponentOk trigger.

    This component can reuse the connection information from the tS3Connection component:

  4. This component reports the existence of the S3 bucket as a Boolean global variable named tS3BucketExist_1.BUCKET_EXIST:
  5. To create the bucket if it doesn't already exist, add a tS3BucketCreate component and connect it to tS3BucketExist with a Run If trigger.

    Set the condition on the Run If trigger as follows:

    This condition means that the tS3BucketCreate will execute only if the bucket does not exist.

  6. Open the Component view of the tS3BucketCreate component and provide the bucket name:
  7. Run your Job.
  8. When the Job has executed, from the Amazon Web Services home page, navigate to S3:

    You will reach the Amazon S3 home page, where you can see the list of your buckets. You should find your new bucket created from the Talend Studio:

    In a similar way, you can delete an existing bucket using the tS3BucketDelete component.

    Warning:

    Make sure that your bucket name is unique. Otherwise, you may inadvertently work on someone else's bucket.