Configuration wizard in Map/Reduce Jobs - 7.0

Data matching

author
Talend Documentation Team
EnrichVersion
7.0
EnrichProdName
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Data Quality components > Matching components > Data matching components
Data Quality and Preparation > Third-party systems > Data Quality components > Matching components > Data matching components
Design and Development > Third-party systems > Data Quality components > Matching components > Data matching components
EnrichPlatform
Talend Studio

The match results on multiple conditions will list data records that meet any of the defined rules.

You can not open the configuration wizard unless you link an input component to the tMatchGroup component.

From the configuration wizard in tMatchGroup, you can:
  • define multiple conditions using several match rules to group data,

  • set different match intervals for each rule,

  • import match rules created and tested in the studio and stored in the repository, and use them in your match Jobs. You can only import rules configured with the VSR algorithm. For further information, see Importing match rules from the studio repository.

  • select a blocking key to partition data.

Procedure

  1. Click the [+] button on the match rule bar.
  2. Set the parameters for the new rule in the Key definition table and define its match interval.
  3. Repeat the above steps to create as many match rules as needed. You can define a different match interval for each rule.
    When you define multiple rules, the Job conducts an OR match operation. It evaluates data records against the first rule and the records that match are not evaluated against the second rule.
  4. In the Blocking Selection table, select the column(s) from the input flow which you want to use as a blocking key.
    Defining a blocking key is not mandatory but is very useful when you are processing big data sets. A blocking key partitions data in blocks and so reduces the number of records that need to be examined. This key can come from a tGenKey component (and would be called T_GEN_KEY) or directly from the input schema.
  5. At the bottom right corner of the wizard, click either:
    • OK to save the current configuration.

    • Cancel to close the wizard and keep the configuration saved initially in the wizard.