tDynamoDBConfiguration properties for Apache Spark Batch - 7.1

Amazon DynamoDB

author
Talend Documentation Team
EnrichVersion
7.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Amazon services (Integration) > Amazon DynamoDB components
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon DynamoDB components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon DynamoDB components
EnrichPlatform
Talend Studio

These properties are used to configure tDynamoDBConfiguration running in the Spark Batch Job framework.

The Spark Batch tDynamoDBConfiguration component belongs to the Storage and the Databases families.

The component in this framework is available in all subscription-based Talend products with Big Data and Talend Data Fabric.

Basic settings

Access key

Enter the access key ID that uniquely identifies an AWS Account. For further information about how to get your Access Key and Secret Key, see Getting Your AWS Access Keys.

Secret key

Enter the secret access key, constituting the security credentials in combination with the access Key.

To enter the secret key, click the [...] button next to the secret key field, and then in the pop-up dialog box enter the password between double quotes and click OK to save the settings.

Region

Specify the AWS region by selecting a region name from the list. For more information about the AWS Region, see Regions and Endpoints.

Use End Point

Select this check box and in the field displayed, specify the Web service URL of the DynamoDB database service.

Usage

Usage rule

This component is used with no need to be connected to other components.

The configuration in a tDynamoDBConfiguration component applies only on the DynamoDB related components in the same Job. In other words, the DynamoDB components used in a child or a parent Job that is called via tRunJob cannot reuse this configuration.

This component, along with the Spark Batch component Palette it belongs to, appears only when you are creating a Spark Batch Job.

Note that in this documentation, unless otherwise explicitly stated, a scenario presents only Standard Jobs, that is to say traditional Talend data integration Jobs.