Populating an existing MySQL table with leads from Michigan - Cloud

Talend Cloud Apps Connectors Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Data Inventory
Talend Data Preparation
Talend Pipeline Designer
Content
Administration and Monitoring > Managing connections
Design and Development > Designing Pipelines
Last publication date
2024-03-21

Before you begin

  • You have previously created a Test connection to store your source data.

  • You have previously added the dataset holding your source data, here new leads information such as their ID, first name, last name, city and state.

  • You also have created the connection and the related dataset that will hold the new leads, here a MySQL database table.

Procedure

  1. Click Add pipeline on the Pipelines page. Your new pipeline opens.
  2. Give the pipeline a meaningful name; Populate MySQL table with test data for example.
  3. Click ADD SOURCE to open the panel allowing you to select your source data, here a list of 30 new lead information.
  4. Select your dataset and click Select in order to add it to the pipeline. Rename it if needed.

    Example

  5. Click and add a Filter processor to the pipeline that will allow you to only keep the leads that live in the Michigan state. The configuration panel opens.
  6. Give a meaningful name to the processor; filter on Michigan leads for example.
  7. In the Filter area:
    1. Select .state in the Input list, as you want to process customer states.
    2. Select None in the Apply a function first list, as you do not want to apply a function while filtering records.
    3. Select == in the Operator list and type in Michigan in the Value list as you want to filter on customers who live in the Michigan state.
  8. Click Save to save your configuration.

    The data is filtered and only leads living in Michigan are kept.

  9. Click the ADD DESTINATION item on the pipeline to open the panel allowing to select the dataset that will hold your output data (MySQL table).
  10. Give a meaningful name to the Destination; MySQL Michigan lead table for example.
  11. In the Action field of the MySQL destination configuration, select INSERT as you want to insert the data in the existing MySQL table.
  12. Click Save to save your configuration.
  13. On the top toolbar of Talend Cloud Pipeline Designer, click the Run button to open the panel allowing you to select your run profile.
  14. Select your run profile in the list (for more information, see Run profiles), then click Run to run your pipeline.

Results

Your pipeline is being executed, the leads are being filtered and the output flow is sent to the MySQL table listing leads from Michigan.