Creates groups of similar data records in any source data including large volumes of data by using one or several match rules.
tMatchGroup compares columns in both standard input data flows and in M/R input data flows by using matching methods and groups similar encountered duplicates together.
Several tMatchGroup components can be used sequentially to match data against different blocking keys. This will refine the groups received by each of the tMatchGroup components through creating different data partitions that overlap previous data blocks and so on.
In defining a group, the first processed record of each group is the master record of the group. The other records are computed as to their distances from the master records and then are distributed to the due master record accordingly.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Standard: see tMatchGroup Standard properties.
The component in this framework is available in Talend Data Management Platform, Talend Big Data Platform, Talend Real Time Big Data Platform, Talend Data Services Platform, and in Talend Data Fabric.
-
MapReduce: see tMatchGroup MapReduce properties (deprecated).
The component in this framework is available in all Talend Platform products with Big Data and in Talend Data Fabric.