tGSCopy properties - 6.3

Talend Open Studio for Big Data Components Reference Guide

EnrichVersion
6.3
EnrichProdName
Talend Open Studio for Big Data
task
Data Governance
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

Component Family

Big Data / Google Cloud Storage

 

Basic settings

Use an existing connection

Select this check box and in the Component List click the relevant connection component to reuse the connection details you already defined.

 

Access Key and Secret Key

Type in the authentication information obtained from Google for making requests to Google Cloud Storage.

These keys can be consulted on the Interoperable Access tab view under the Google Cloud Storage tab of the project from the Google APIs Console.

To enter the secret key, click the [...] button next to the secret key field, and then in the pop-up dialog box enter the password between double quotes and click OK to save the settings.

For more information about the access key and secret key, go to https://developers.google.com/storage/docs/reference/v1/getting-startedv1?hl=en/ and see the description about developer keys.

Warning

The Access Key and Secret Key fields will be available only if you do not select the Use an existing connection check box.

 

Source bucket name

Specify the name of the bucket from which you want to copy or move objects.

 

Source object key

Specify the key of the object to be copied.

 

Source is folder

Select this check box if the source object is a folder.

 

Target bucket name

Specify the name of the bucket to which you want to copy or move objects.

 

Target folder

Specify the target folder to which the objects will be copied or moved.

 

Action

Select the action that you want to perform on objects from the list.

  • Copy: copies objects from the source bucket or folder to the target bucket or folder.

  • Move: moves objects from the source bucket or folder to the target bucket or folder.

 

Rename

Select this check box and in the New name field enter a new name for the object to be copied or moved.

Warning

The Rename check box will not be available if you select the Source is folder check box.

 

Die on error

This check box is cleared by default, meaning to skip the row on error and to complete the process for error-free rows.

Advanced settings

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at the Job level as well as at each component level.

Global Variables

SOURCE_BUCKET: the source bucket name. This is an After variable and it returns a string.

SOURCE_OBJECTKEY: the key of a source object. This is an After variable and it returns a string.

DESTINATION_BUCKETNAME: the destination bucket name. This is an After variable and it returns a string.

DESTINATION_FOLDER: the destination folder. This is an After variable and it returns a string.

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl + Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio User Guide.

Usage

This component can be used as a standalone component.

Log4j

If you are using a subscription-based version of the Studio, the activity of this component can be logged using the log4j feature. For more information on this feature, see Talend Studio User Guide.

For more information on the log4j logging levels, see the Apache documentation at http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/Level.html.

Limitation

n/a