tSalesforceOutputBulkExec Standard properties - Cloud - 8.0

Salesforce

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Business applications > Salesforce components
Data Quality and Preparation > Third-party systems > Business applications > Salesforce components
Design and Development > Third-party systems > Business applications > Salesforce components
Last publication date
2024-03-07

These properties are used to configure tSalesforceOutputBulkExec running in the Standard Job framework.

The Standard tSalesforceOutputBulkExec component belongs to the Business and the Cloud families.

The component in this framework is available in all Talend products.

Basic settings

Property Type

Select the way the connection details will be set.

  • Built-In: The connection details will be set locally for this component. You need to specify the values for all related connection properties manually.

  • Repository: The connection details stored centrally in Repository > Metadata will be reused by this component.

    You need to click the [...] button next to it and in the pop-up Repository Content dialog box, select the connection details to be reused, and all related connection properties will be automatically filled in.

This property is not available when other connection component is selected from the Connection Component drop-down list.

Connection Component

Select the component that opens the database connection to be reused by this component.

Connection type

Select the type of the connection from the drop-down list. The connection properties will vary according to the connection type you choose.

  • Basic: select this option to access Salesforce by entering your Salesforce username and password.

  • OAuth: select this option to access Salesforce using OAuth (Open Authorization) 2.0 protocol to authenticate the user with the Json Web Token Flow OAuth 2.0 authentication flow type. To use this option, you need to create a connected app in Salesforce to configure a Salesforce authentication provider.

    For more information about the OAuth authentication flow, see Authenticate Apps with OAuth.

    For more information about how to create a connected app in Salesforce, see Create a Connected App.

User Id

The Salesforce username.

This property is available only when the Basic connection type is selected.

Password

The Salesforce password associated with the username.

This property is available only when the Basic connection type is selected.

Security Token

The Salesforce security token. For more information, see Reset Your Security Token.

This property is available only when the Basic connection type is selected.

Mutual authentication

Select this option to enable mutual authentication for establishing connections to Salesforce. For more information about mutual authentication in Salesforce, see Set Up a Mutual Authentication Certificate.

If you are using this option:

  • On the component side, use a tSetKeystore component to provide the mutual authentication keystore and keystore password.

  • On the metadata side, go to Window > Preferences > Talend > Security > SSL, and set the corresponding keystore configuration.

By default, this option is not selected.

Mutual auth keystore (Deprecated)

Enter the path to the mutual authentication keystore file, a password protected file containing keys and certificates.

This option is deprecated, it is recommended to use a tSetKeystore component to provide the mutual authentication keystore and keystore password.

This option is available when both the Basic connection type and the Mutual authentication check box are selected.

Mutual auth keystore password

Enter the password for the mutual authentication keystore file.

This option is available when both the Basic connection type and the Mutual authentication check box are selected.

Issuer

The OAuth Consumer Key, generated when your connected app is created and shown in the connected app detail page in Salesforce. For more information, see Create a Connected App.

This property is available only when the OAuth connection type is selected.

Subject

The Salesforce username.

This property is available only when the OAuth connection type is selected.

Audience

Json Web Token audience.

You can set your own Json Web Token audience.

This property is available only when the OAuth connection type is selected.

Expiration time (in seconds)

The expiration time of the assertion (in seconds) within five minutes.

This property is available only when the OAuth connection type is selected.

Key store

The path to the keystore file in Java Keystore (JKS) format.

The keystore file can be generated by creating a certificate signed by Salesforce and then exporting it to keystore. For more information, see Generate a Self-Signed Certificate.

This property is available only when the OAuth connection type is selected.

Key store password

The keystore password.

This property is available only when the OAuth connection type is selected.

Certificate alias

The unique name of the certificate signed by Salesforce.

This property is available only when the OAuth connection type is selected.

Client Id

The OAuth Consumer Key, generated when your connected app is created and shown in the connected app detail page in Salesforce. For more information, see Create a Connected App.

This property is available only when the OAuth Implicit Flow type is selected.

Client Secret

The OAuth Consumer Secret, generated when your connected app is created and shown in the connected app detail page in Salesforce. For more information, see Create a Connected App.

This property is available only when the OAuth Implicit Flow type is selected.

Callback Host

The host value in the OAuth authentication callback URL that is defined during the creation of a connected app and will be shown in the API (Enable OAuth Settings) area of the connected app detail page in Salesforce.

This property is available only when the OAuth Implicit Flow type is selected.

Callback Port

The port value in the OAuth authentication callback URL that is defined during the creation of a connected app and will be shown in the API (Enable OAuth Settings) area of the connected app detail page in Salesforce.

This property is available only when the OAuth Implicit Flow type is selected.

Token File

The path to the token file that stores the refresh token used to get the access token without authorization.

This property is available only when the OAuth Implicit Flow type is selected.

Module Name

Click the [...] button next to the field and in the dialog box displayed, select the module that will be used or select the Use custom object check box and specify the module name in the Object Name field.

Schema and Edit schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

  • View schema: choose this option to view the schema only.

  • Change to built-in property: choose this option to change the schema to Built-in for local changes.

  • Update repository connection: choose this option to change the schema stored in the repository and decide whether to propagate the changes to all the Jobs upon completion.

    If you just want to propagate the changes to the current Job, you can select No upon completion and choose this schema metadata again in the Repository Content window.

Click Sync columns to retrieve the schema from the previous component connected in the Job.

This component offers the advantage of the dynamic schema feature. This allows you to retrieve unknown columns from source files or to copy batches of columns from a source without mapping each column individually. For further information about dynamic schemas, see Dynamic schema.

This dynamic schema feature is designed for the purpose of retrieving unknown columns of a table and is recommended to be used for this purpose only; it is not recommended for the use of creating tables.

Output Action

Select one of the following operations to be performed from the drop-down list.

  • INSERT: insert one or more new records into Salesforce.

  • UPDATE: update one or more existing records in Salesforce.

  • UPSERT: create new records or update existing records. In the Upsert Key Column field displayed, specify the key column for the upsert operation. By selecting Output upsert column, a column named UpsertColumnValue will be added to the output schema. The column holds upsert key values and thus can be used to monitor the upsert key. You can select Output upsert column if the upsert key is a variable.

  • DELETE: delete one or more records in Salesforce.

Bulk File Path

Specify the path to the file that stores the data to be processed.

Append

Select this check box to append new data at the end of the file if it already exists, instead of overwriting the existing data.

Ignore Null

Select this check box to ignore NULL values.

Advanced settings

Salesforce URL

The Webservice URL required to connect to Salesforce.

Warning: Due to a breaking change in the latest versions of Salesforce, if you use the Basic connection type with mutual authentication, you need to adjust the endpoint to prevent errors while running the Job. Example: https://MyDomainName.my.salesforce.com:8443/services/Soap/u/57.0

API version

The Salesforce API version.

This property is available only when the OAuth connection type is selected.

Need compression

Select this check box to activate SOAP message compression, which can result in increased performance levels.

Trace HTTP message

Select this check box to output the HTTP interactions on the console.

Client Id

Enter the ID of the real user to differentiate between those who use the same account and password to access the Salesforce website.

Timeout

Enter the intended number of query timeout in milliseconds in Salesforce.

Use Proxy

Select this check box to use a SOCKS proxy server, and in the Host, Port, User Id, and Password fields displayed, specify the connection parameters of the SOCKS proxy server.

Note: To use a proxy of any allowed type (including HTTP proxy, HTTPS proxy, SOCKS proxy, and FTP proxy), use the tSetProxy component.

Bulk API V2

Select this checkbox to create a Bulk API V2 Job, and then select a type of field delimiter from the Column Delimiter drop-down list and a way of line ending from the Line Ending drop-down list respectively for CSV data.

Compared with Bulk API V1, Bulk API v2 simplifies the way of processing data.

This property is available only when the OAuth connection type is selected.

Relationship mapping for upsert

Click the [+] button to add lines as needed and specify the external ID fields in the input flow, the lookup relationship fields in the upsert module, the lookup module as well as the external ID fields in the lookup module.

  • Column name of Talend Schema: the name of the external ID field in the input flow. It refers to the fields in the schema of the preceding component. Such columns are intended to match against the external ID fields specified in the External id name column, which are the fields of the lookup module specified in the Module name column.

  • Lookup relationship field name: the name of the lookup relationship field. It refers to the lookup relationship fields of the module specified in the Module Name field in the Basic settings view and is intended to establish relationship with the lookup module specified in the Module name column in this table. You can enter built-in relationship fields and custom relationship fields. For information about how to define the lookup relationship fields and how to provide their correct names in the Lookup relationship field name field, go to the Salesforce website and launch the Salesforce Data Loader application for proper actions and information.

  • Module name: the name of the lookup module.

  • Polymorphic: select this check box when and only when polymorphic fields are used for relationship mapping. You will get an error if you keep this check box cleared for a polymorphic field or select it for a field that is not polymorphic. For more information about the polymorphic fields, search polymorphic at http://www.salesforce.com/us/developer/docs/api_asynch/.

  • External id name: the name of the external ID field in the lookup module specified in the Module name column.

This property is available only when UPSERT is selected from the Output Action drop-down list.

Concurrency Mode

Select the concurrency mode for the Job.

  • Parallel: process batches in parallel mode.

  • Serial: process batches in serial mode.

Rows to Commit

Specify the number of lines per data batch to be processed.

Bytes to Commit

Specify the number of bytes per data batch to be processed.

Wait Time Check Batch State

Specify the wait time (in milliseconds) for checking whether the batches in a Job have been processed until all batches are finally processed.

Safety Switch

Clear this check box if the length of any column of the module to be queried is longer than 100,000 characters. By default, this check box is selected to prevent excessive memory usage.

This property is available when Bulk or BulkV2 is selected from the Query Mode drop-down list.

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at the Job level as well as at each component level.

Global Variables

ERROR_MESSAGE

The error message generated by the component when an error occurs. This is an After variable and it returns a string.

Usage

Usage rule

This component is mainly used when no particular transformation is required on the data to be loaded into Salesforce.

Limitation

The bulk data to be processed in Salesforce should be in .csv format.