Configuring the components - 7.3

Processing (Integration)
Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Processing components (Integration)
Data Quality and Preparation > Third-party systems > Processing components (Integration)
Design and Development > Third-party systems > Processing components (Integration)
Last publication date
2023-09-12

Procedure

  1. Double-click the component labelled People to display its Basic settings view.
    Warning:

    The dynamic schema feature is only supported in Built-In mode and requires the input file to have a header row.

  2. Click the [...] button next to the File Name/Stream field to browse to your input file.
  3. Define the header and footer rows. In this use case, the first row of the input file is the header row.
  4. Click Edit schema to define the schema for this component.
    In this use case, the input file has five columns: FirstName, LastName, HouseNo, Street, and City. However, as we can leverage the advantage of the dynamic schema feature, we simply define one dynamic column in the schema, Dyna in this example.
    To do so :
    1. Add a new line by clicking the [+] button.
    2. Type Dyna in the Column field.
    3. Select Dynamic from the Type list.
    4. Then, click OK to propagate the schema and close the Schema dialog box.
  5. Double-click the component labelled Split_Column to display its Basic settings view.
    We will use this component to split the dynamic column of the input schema into two columns, one for the first name and the other for the family related information. To do so:
    1. Click Edit schema to open the Schema dialog box.
    2. In the output panel, click the [+] button to add two columns for the output schema, and name them FirstName and FamilyInfo respectively.
    3. Select String from the Type list for the FirstName column to extract this column from the input schema to carry the first name of each person on the name list.
    4. Select Dynamic from the Type list for the FamilyInfo column so that this column will carry the rest information of each person on the name list: the last name, house number, street and city, which all together will identify a family.
    5. Then, click OK to propagate the schema and close the Schema dialog box.
  6. Double-click the component labelled Deduplicate to display its Basic settings view.
  7. In the Unique key area, select the Key attribute check box for the FamilyInfo column to carry out deduplication on the family information.
  8. In the Basic settings view of the tFileOutputDelimited component, which is labelled Deduplicated_Families, define the output file path, select the Include header check box, and leave the other settings as they are.
  9. In the Basic settings view of the tLogRow component, which is labelled Duplicated_Families, select the Table option to view the Job execution result in table mode.