Filtering Salesforce contacts and inserting them into a Snowflake database - Cloud

Talend Cloud Apps Connectors Guide

Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Data Inventory
Talend Data Preparation
Talend Pipeline Designer
Content
Administration and Monitoring > Managing connections
Design and Development > Designing Pipelines
Last publication date
2024-03-21

This scenario aims at helping you set up and use connectors in a pipeline. You are advised to adapt it to your environment and use case.

Procedure

  1. Click Connections > Add connection.
  2. In the panel that opens, select the type of connection you want to create.

    Example

    salesforce
  3. Select your engine in the Engine list.
    Note:
    • It is recommended to use the Remote Engine Gen2 rather than the Cloud Engine for Design for advanced processing of data.
    • If no Remote Engine Gen2 has been created from Talend Management Console or if it exists but appears as unavailable which means it is not up and running, you will not be able to select a Connection type in the list nor to save the new connection.
    • The list of available connection types depends on the engine you have selected.
  4. Select the type of connection you want to create.
    Here, select Salesforce.
  5. Fill in the connection properties to access your Salesforce account as described in Salesforce properties, check the connection and click Add dataset.
  6. In the Add a new dataset panel, name your dataset. In this example, a query is used to retrieve contact names and emails stored on a Salesforce.

    Example

    contacts on salesforce
  7. Fill in the required properties to query the table located in your Salesforce acount and click View sample to see a preview of your dataset sample.
  8. Click Validate to save your dataset.
  9. Do the same to add the Snowflake database and table that will be used as destination in your pipeline. Fill in the connection properties as described in Snowflake properties.

    In this example, a Snowflake table named TALEND_CONTACTS is used.

  10. Click Add pipeline on the Pipelines page. Your new pipeline opens.
  11. Give the pipeline a meaningful name.

    Example

    From Salesforce to Snowflake - processing & inserting
  12. Click ADD SOURCE and select your source dataset, contacts on salesforce in the panel that opens.
  13. Click to add processors to the pipeline, for example a Filter processor to filter on emails that contain @talend.com, and give them a meaningful name.
  14. Click the ADD DESTINATION item on the pipeline to open the panel allowing to select the Snowflake table in which your output data will be inserted.
  15. Give a meaningful name to the Destination; load in Snowflake for example.
  16. In the Configuration tab of the destination, click Main and select Insert in the Action list to insert the data into the table when executing the pipeline.
  17. Click Save to save your configuration.
  18. (Optional) Click the last processor to preview the processed data.
  19. On the top toolbar of Talend Cloud Pipeline Designer, click the Run button to open the panel allowing you to select your run profile.
  20. Select your run profile in the list (for more information, see Run profiles), then click Run to run your pipeline.

Results

Your pipeline is being executed, the customer data that was stored on Salesforce has been processed and the output flow is inserted into the Snowflake target table you have defined.