Creating a match rule - 7.3

Talend Open Studio User Guide

Version
7.3
Language
English
Product
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for Data Quality
Talend Open Studio for ESB
Module
Talend Studio
Content
Design and Development
Last publication date
2023-10-11
Available in...

Open Studio for Data Quality

In data quality, match rules are used to compare a set of columns and create groups of similar records using blocking and matching keys and/or survivorship functions.

From the Profiling perspective, you can create match rules with the VSR or the T-Swoosh algorithm and save them in the Studio repository. Once centralized in the repository, you can import them in the match analysis editor and test them on your data to group duplicate records. For further information about the match analysis, see Creating a match analysis above.

You can also import rules defined with the VSR algorithm in the tMatchGroup configuration wizard and in other match components, including the Hadoop components, and use the rules in match Jobs. For further information, see the tMatchGroup documentation.

The two algorithms produce different match results because of two reasons:
  1. The master record is simply selected to be the first input record with the VSR algorithm. Therefore, the list of match groups may depend on the order of the input records,

  2. The output records do not change with the VSR algorithm, whereas the T-Swoosh algorithm creates new records.