tStandardizeRow - Cloud - 8.0

Standardization

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Data Quality components > Standardization components
Data Quality and Preparation > Third-party systems > Data Quality components > Standardization components
Design and Development > Third-party systems > Data Quality components > Standardization components
Last publication date
2024-02-20

Normalizes the incoming data in a separate XML or JSON data flow to separate or standardize the rule-compliant data from the non-compliant data.

tStandardizeRow tokenizes the data flow it has received from the preceding component and applies user-defined parser rules to analyze the data. Based on this analysis, this component normalizes and writes analyzed data in a separate data flow and tags them using the user-defined rule names. It does not make any changes on your raw data.

The standardization option adds a supplementary column to the output flow where the normalized data are then standardized.

The Java library ANTLR is used to parse and tokenize the incoming data. For further information about ANTLR, see the site

http://www.antlr.org/

In local mode, Apache Spark 2.4.0 and later versions are supported.

Note: If your indexes were created with Talend Studio 7.2 or earlier, you need to update them. The location of the migration procedure depends on the Talend Studio installation:
  • With the installer: /addons/scripts/Lucene_Migration_Tool/README.md.
  • With no installer: in the license email, click the link in Migration tool for Lucene Indexes from version 4 to version 8.

This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.

For more technologies supported by Talend, see Talend components.