tMatchPredict - 7.0

Matching with machine learning

author
Talend Documentation Team
EnrichVersion
7.0
EnrichProdName
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Data Quality components > Matching components > Matching with machine learning components
Data Quality and Preparation > Third-party systems > Data Quality components > Matching components > Matching with machine learning components
Design and Development > Third-party systems > Data Quality components > Matching components > Matching with machine learning components
EnrichPlatform
Talend Data Stewardship
Talend Studio

Labels suspect records automatically and groups suspect records which match the label(s) set in the component properties.

tMatchPredict labels suspect pairs based on the pairing and matching models generated by the tMatchPairing and tMatchModel components.

If the input data is new and has not been paired previously, you can define the input data as "unpaired" and set the path to the pairing model folder to separate the exact duplicates from unique records.

tMatchPredict can also output unique records, exact duplicates and suspect duplicates from a new data set.

This component can run only with the following Hadoop distributions with Spark 1.6+ and 2.0:

  • Spark 1.6: CDH5.7, CDH5.8, HDP2.4.0, HDP2.5.0, MapR5.2.0, EMR4.5.0, EMR4.6.0.

  • Spark 2.0: EMR5.0.0.

For more technologies supported by Talend, see Talend components.