tDynamoDBConfiguration properties for Apache Spark Batch - 7.3

Amazon DynamoDB

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Amazon services (Integration) > Amazon DynamoDB components
Data Quality and Preparation > Third-party systems > Amazon services (Integration) > Amazon DynamoDB components
Design and Development > Third-party systems > Amazon services (Integration) > Amazon DynamoDB components
Last publication date
2024-02-21

These properties are used to configure tDynamoDBConfiguration running in the Spark Batch Job framework.

The Spark Batch tDynamoDBConfiguration component belongs to the Storage and the Databases families.

The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.

Basic settings

Inherit credentials from AWS role

Select this check box to leverage the instance profile credentials. These credentials can be used on Amazon EC2 instances, and are delivered through the Amazon EC2 metadata service. To use this option, your Job must be running within Amazon EC2 or other services that can leverage IAM Roles for access to resources. For more information, see Using an IAM Role to Grant Permissions to Applications Running on Amazon EC2 Instances.

Access key

Enter the access key ID that uniquely identifies an AWS Account. For further information about how to get your Access Key and Secret Key, see Getting Your AWS Access Keys.

Note: This option is available when Use an existing connection and Inherit credentials from AWS role are cleared.

Secret key

Enter the secret access key, constituting the security credentials in combination with the access Key.

To enter the secret key, click the [...] button next to the secret key field, and then in the pop-up dialog box enter the password between double quotes and click OK to save the settings.

Note: This option is available when Use an existing connection and Inherit credentials from AWS role are cleared.

Region

Specify the AWS region by selecting a region name from the list. For more information about the AWS Region, see Regions and Endpoints.

Use End Point

Select this check box and in the field displayed, specify the Web service URL of the DynamoDB database service.

Usage

Usage rule

This component is used with no need to be connected to other components.

The configuration in a tDynamoDBConfiguration component applies only on the DynamoDB related components in the same Job. In other words, the DynamoDB components used in a child or a parent Job that is called via tRunJob cannot reuse this configuration.

This component, along with the Spark Batch component Palette it belongs to, appears only when you are creating a Spark Batch Job.

Note that in this documentation, unless otherwise explicitly stated, a scenario presents only Standard Jobs, that is to say traditional Talend data integration Jobs.