Setting up the Job

Scenario: Labeling suspect pairs with assigned labels

EnrichVersion
Cloud
6.4
EnrichProdName
Talend Data Fabric
Talend Data Management Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Talend Big Data Platform
Talend Data Services Platform
task
Data Governance > Third-party systems > Data Quality components > Matching components > Matching with machine learning components
Design and Development > Third-party systems > Data Quality components > Matching components > Matching with machine learning components
Data Quality and Preparation > Third-party systems > Data Quality components > Matching components > Matching with machine learning components
EnrichPlatform
Talend Studio

Procedure

  1. Drop the following components from the Palette onto the design workspace: tFileInputDelimited, tMatchPredict and tFileOutputDelimited.
  2. Connect tFileInputDelimited to tMatchPredict using the Main link.
  3. Connect tMatchPredict to tFileOutputDelimited using the Suspect duplicates link.
  4. Check that you have defined the connection to the Spark cluster and activated checkpointing in the Run > Spark Configuration view as described in Scenario 2: Computing suspect pairs and suspect sample from source data.

Results