Retrieving fixed fields from a Data Stewardship campaign - Cloud

Talend Cloud Apps Connectors Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Data Inventory
Talend Data Preparation
Talend Pipeline Designer
Content
Administration and Monitoring > Managing connections
Design and Development > Designing Pipelines
Last publication date
2024-03-21

This scenario aims at helping you set up and use connectors in a pipeline. You are advised to adapt it to your environment and use case.

Before you begin

  • You have created a Test connection and dataset that will hold the output logs. See Test connection properties for more information.
  • A task assigned to the data steward, that is fixing customer data with empty emails in a Resolution campaign, has been completed.
  • You have the Campaign owner role that allows you to display and retrieve the campaign in Talend Cloud Pipeline Designer. See this documentation for more information.

Procedure

  1. Click Add pipeline on the Pipelines page. Your new pipeline opens.
  2. Give the pipeline a meaningful name.

    Example

    Retrieve corrections from Stewardship campaign
  3. Click ADD SOURCE and go the Campaigns tab to retrieve the Resolution campaign in which the task that consisted in fixing empty email fields has been completed.
    You can see that the campaign task retrieved has the RESOLVED state and the FIXED tag, which means the fields with invalid emails where fixed by the data steward assigned to this task:
  4. Click and add a Field Selector processor to the pipeline in order to select and keep only the ID and EMAIL fields. The configuration panel opens.
  5. Give a meaningful name to the processor.

    Example

    select ID and EMAIL fields
  6. In the Selectors area of the Advanced mode:
    1. Select .ID in the Input list and enter ID in the Output field, as you want to select the fields corresponding to customer identifiers.
    2. Click the + sign to add a new element and select .EMAIL in the Input list and enter EMAIL in the Output field, as you want to select the fields corresponding to customer emails.
    3. Click Save to save your configuration.
      The selected fields (including the fixed emails) are kept and renamed according to your configuration.
  7. Click the ADD DESTINATION item and select the Test dataset that will hold the output logs..
  8. Give a meaningful name to the destination; output logs for example.
  9. In the Configuration tab of the destination, click the Main tab:
    1. Enable the Log records to STDOUT option to capture the logs into this output destination.
    2. Click Save to save your configuration.
  10. On the top toolbar of Talend Cloud Pipeline Designer, click the Run button to open the panel allowing you to select your run profile.
  11. Select your run profile in the list (for more information, see Run profiles), then click Run to run your pipeline.

Results

Your pipeline is being executed, the fixed customer emails have been retrieved and the logs are captured in the destination you have defined.

What to do next

  • If the data steward was not able to find the missing emails, you will be able to delete the invalid fields from the campaign in Talend Cloud Pipeline Designer.