Enriching the semantic types libraries - 8.0

Talend Data Preparation User Guide

Version
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Data Preparation
Content
Data Quality and Preparation > Cleansing data
Last publication date
2024-03-26
When you add a dataset, Talend Data Preparation automatically suggests, for each column, the best data type or semantic type that matches the data.

If the semantic type proposed by Talend Data Preparation for one column is not the desired one, you can manually change it by clicking the menu icon in the column header.

This allows you to choose among the list of semantic types present in Talend Data Preparation by default. See Predefined Semantic Types for more information. You can go further by creating your own semantic types, as well as updating or deleting the existing ones, so that Talend Data Preparation speaks your business language.

The semantic types modifications are made directly in the Talend Data Preparation interface, via the Semantic types tab of the left menu.
All the changes are stored using Talend Dictionary Service and are propagated across various Talend products.

The availability of Talend Dictionary Service depends on the license you have.

In Talend Dictionary Service, the semantic types are divided into three main categories:
  • The DICT type, based on an open or closed list of values.
  • The REGEX type that compares your data against a preselected regular expression.
  • The COMPOUND type, under which you can group several existing types.

To enable the interaction between Talend Dictionary Service and Talend Data Preparation, you must fulfill the following prerequisites:

  • Talend Dictionary Service is installed and running.
  • Talend Administration Center is installed and running.
  • You have a Platform license or a Talend Data Fabric license.
  • The Dictionary Service User check box is selected for your user in Talend Administration Center.
  • In the <install_folder>\dataprep\config\application.properties file, the dataquality.semantic.update.enable and dataquality.semantic.list.enable properties are set as true.
  • In the <install_folder>\dataprep\config\application.properties file, you have set the URL to your Talend Dictionary Service instance with the semanticservice.url parameter.