Analyzing duplicates - Cloud - 7.3

Talend Studio User Guide

Version
Cloud
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development
Available in...

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

You can use the match analysis in the Profiling perspective of Talend Studio to compare columns in databases or delimited files and create groups of similar records using the VSR or the T-Swoosh algorithm.

This analysis provides you with a simple way to create match rules, test them on a set of columns and see the results directly in the editor. After testing your match rules on data, you can export them from the editor and save them in the Studio repository to be imported and used later in the matching components including tMatchGroup, tRecordMatching, tGenkey and the Hadoop matching components for example.

You can also use the Profiling perspective to define match rules in a match rule editor and save them in the Talend Studio repository.