Adding a Grouping campaign to identify duplicate pairs - Cloud

Talend Cloud Data Stewardship Examples

author
Talend Documentation Team
EnrichVersion
Cloud
EnrichProdName
Talend Cloud
task
Data Governance > Assigning tasks
Data Governance > Managing campaigns
Data Governance > Managing data models
Data Quality and Preparation > Handling tasks
EnrichPlatform
Talend Data Stewardship

A Grouping campaign defines a list of possible arbitration choices for pairs or groups of records. The outcome of a grouping task is the choice made by data stewards on the group of records.

A typical use case for this campaign is to label suspect duplicate pairs in the context of matching very high volume of data using machine learning on Spark. Another use case for the campaign is to identify the groups of potential duplicates before sending them to a Merging campaign where data stewards can merge duplicates into master records.

The Grouping campaign in this example is used in the process of machine learning on Spark. It identifies duplicates in a sample data extracted from a long list of early childhood education centers in Chicago coming from ten different sources. This step in data matching comes after computing suspect duplicates in the agencies list by using the tMatchPairing component.

Once campaign owners create the campaign, data stewards need to look at the sample data and decide whether pairs of record are duplicate.

Before you begin

  • An administrator has created stewardship users and assigned them roles in Talend Cloud Management Console. For further information about managing users, see Talend Cloud Management Console User Guide.

  • You have been assigned the campaign owner role in Talend Cloud Management Console, or assigned a role with permissions to add and manage data models and campaigns.

  • You have accessed Talend Cloud Data Stewardship as a campaign owner.