Scenario: Replacement from a reference file - 6.3

Talend Open Studio for Big Data Components Reference Guide

EnrichVersion
6.3
EnrichProdName
Talend Open Studio for Big Data
task
Data Governance
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

The following Job searches and replaces a list of states with their corresponding two-letter codes. The relevant codes are taken from a reference file placed as lookup flow in the Job.

Setting up the Job

  1. Drop the following components from the Palette onto the design workspace: two tFileInputDelimited components, a tReplaceList and a tLogRow.

  2. Connect the two tFileInputDelimited components to the tReplaceList component using Row > Main connections. Note that the link between the reference input component (the second tFileInputDelimited) and the tReplaceList component appears as a lookup row.

  3. Connect the tReplaceList component to the tLogRow component using a Row > Main connection.

Configuring the components

  1. Double-click the first tFileInputDelimited component to open its Basic settings view and set the parameters of the main input flow, including the path and name of the file to read and the number of header rows to skip.

    In this example, the main input file provides a list of people names and US state names. The following shows an extract of the file content:

    name;state
    Andrew Kennedy;Mississippi
    Benjamin Carter;Louisiana
    Benjamin Monroe;West Virginia
    Bill Harrison;Tennessee
    Calvin Grant;Virginia
    Chester Harrison;Rhode Island
    Chester Hoover;Kansas
    Chester Kennedy;Maryland
    Chester Polk;Indiana
    Dwight Nixon;Nevada
    Dwight Roosevelt;Mississippi
    Franklin Grant;Nebraska
  2. Click the [...] button next to Edit schema to open the [Schema] dialog box and set the input schema.

    According to the structure of the main input file, the input schema should contain two columns: name and state.

    When done, click OK to close the dialog box and propagate the changes to the next component.

  3. Define the properties of the second tFileInputDelimited component similarly.

    In this example, the reference input file provides a list of states and their two-letter codes. Accordingly, the reference input schema should have two columns: state and code.

  4. Double-click the tReplaceList component to open its Basic settings view to set the operation to carry out.

  5. From the Lookup search column list, select the column to be searched. In this use case, we want to carry out a search on the state column.

  6. From the Lookup replacement column list, select the column containing the replacement values, code for the two-letter state codes in this example.

  7. In the Column options table, select Replace check box for the states column, to replace the state names with their corresponding codes.

  8. In the tLogRow component, select the Table check box for a better readability of the output.

Executing the Job

  • Save the Job and press F6 to execute it.

    The state names have been replaced with their respective two-letter codes.