tAzureStoragePut Standard properties - 7.3

Azure Storage Blob

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Cloud storages > Azure components > Azure Storage Blob components
Data Quality and Preparation > Third-party systems > Cloud storages > Azure components > Azure Storage Blob components
Design and Development > Third-party systems > Cloud storages > Azure components > Azure Storage Blob components
Last publication date
2024-02-21

These properties are used to configure tAzureStoragePut running in the Standard Job framework.

The Standard tAzureStoragePut component belongs to the Cloud family.

The component in this framework is available in all Talend products.

Basic settings

Property Type

Select the way the connection details will be set.

  • Built-In: The connection details will be set locally for this component. You need to specify the values for all related connection properties manually.

  • Repository: The connection details stored centrally in Repository > Metadata will be reused by this component. You need to click the [...] button next to it and in the pop-up Repository Content dialog box, select the connection details to be reused, and all related connection properties will be automatically filled in.

This property is not available when other connection component is selected from the Connection Component drop-down list.

Connection Component

Select the component whose connection details will be used to set up the connection to Azure storage from the drop-down list.

Account Name

Enter the name of the storage account you need to access. A storage account name can be found in the Storage accounts dashboard of the Microsoft Azure Storage system to be used. Ensure that the administrator of the system has granted you the appropriate access permissions to this storage account.

Authentication type

Set the authentication type for connecting to Microsoft Azure Blob storage. Two options are provided: Basic and Azure Active Directory.

Note: This option is available only if you have installed the R2020-03 Studio monthly update or a later one delivered by Talend. For more information, check with your administrator.

Account Key

Enter the key associated with the storage account you need to access. Two keys are available for each account and by default, either of them can be used for this access. Select the component whose connection details will be used to set up the connection to Azure storage from the drop-down list.

This option is available if you select Basic from the Authentication type drop-down list.

Protocol

Select the protocol for this connection to be created.

This option is available if you select Basic from the Authentication type drop-down list.

Use Azure Shared Access Signature

Select this check box to use a shared access signature (SAS) to access the storage resources without need for the account key. For more information, see Using Shared Access Signatures (SAS).

In the Azure Shared Access Signature field displayed, enter your account SAS URL between double quotation marks. You can get the SAS URL for each allowed service on Microsoft Azure portal after generating SAS. The SAS URL format is https://<$storagename>.<$service>.core.windows.net/<$sastoken>, where <$storagename> is the storage account name, <$service> is the allowed service name (blob, file, queue or table), and <$sastoken> is the SAS token value. For more information, see Constructing the Account SAS URI.

Note that the SAS has valid period, you can set the start time at which the SAS becomes valid and the expiry time after which the SAS is no longer valid when generating it, and you need to make sure your SAS is still valid when running your Job.

This option is available if you select Basic from the Authentication type drop-down list.

Tenant ID

Enter the ID of the Azure AD tenant. See Acquire a token from Azure AD for authorizing requests from a client application for related information.

This option is available if you select Azure Active Directory from the Authentication type drop-down list.

Note: This option is available only if you have installed the R2020-03 Studio monthly update or a later one delivered by Talend. For more information, check with your administrator.

Client ID

Enter the client ID of your application. See Acquire a token from Azure AD for authorizing requests from a client application for related information.

This option is available if you select Azure Active Directory from the Authentication type drop-down list.

Note: This option is available only if you have installed the R2020-03 Studio monthly update or a later one delivered by Talend. For more information, check with your administrator.

Client Secret

Enter the client secret of your application. See Acquire a token from Azure AD for authorizing requests from a client application for related information.

This option is available if you select Azure Active Directory from the Authentication type drop-down list.

Note: This option is available only if you have installed the R2020-03 Studio monthly update or a later one delivered by Talend. For more information, check with your administrator.

Container name

Enter the name of the container you need to write files in.

This container must exist in the Azure Storage system you are using.

Local folder

Enter the path, or browse to the folder from which you need to upload files.

Azure storage folder

Enter the path to the virtual blob folder in the remote Azure storage system you want to upload files into.

If you do not put any value in this field but leave this field as it is with only its default quotation marks, tAzureStoragePut writes files directly beneath the container level.

Use file list

Select this check box to be able to define file filtering conditions. Once selecting it, the Files table is displayed.

Files

Complete this table to select the files to be uploaded into Azure. The parameters to be provided are:

  • Filemask: file names or path to the files to be uploaded.

  • New name: name to give to the files after they are uploaded.

Note: To prevent undesired files from being uploaded to the container, do not use these characters in the Filemask column: (, ), [, and ].

Die on error

Select the check box to stop the execution of the Job when an error occurs.

Clear the check box to skip any rows on error and complete the process for error-free rows. When errors are skipped, you can collect the rows on error using a Row > Reject link.

Advanced settings

Allow to escape the '+' sign in filemask

Select this option if you want to use + as a normal character in the filemask strings entered in the Files table in the Basic settings view.

If this option is not selected, + serves as a special RegEx character in the filemask strings.

Note: This option is available only when you have installed the R2021-08 Studio Monthly update or a later one delivered by Talend. For more information, check with your administrator.

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at the Job level as well as at each component level.

Global Variables

CONTAINER

The name of the blob container. This is an After variable and it returns a string.

LOCAL_FOLDER

The local directory used in this component. This is an After variable and it returns a string.

REMOTE_FOLDER

The remote directory used in this component. This is an After variable and it returns a string.

ERROR_MESSAGE

The error message generated by the component when an error occurs. This is an After variable and it returns a string.

Usage

Usage rule

This component can be used as a standalone component of a Job or subJob.

Prerequisites

Knowledge about Microsoft Azure Storage is required.