tStandardizeRow - 7.3

Standardization

EnrichVersion
Cloud
7.3
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Studio
task
Data Governance > Third-party systems > Data Quality components > Standardization components
Data Quality and Preparation > Third-party systems > Data Quality components > Standardization components
Design and Development > Third-party systems > Data Quality components > Standardization components

Normalizes the incoming data in a separate XML or JSON data flow to separate or standardize the rule-compliant data from the non-compliant data.

tStandardizeRow tokenizes the data flow it has received from the preceding component and applies user-defined parser rules to analyze the data. Based on this analysis, this component normalizes and writes analyzed data in a separate data flow and tags them using the user-defined rule names. It does not make any changes on your raw data.

The standardization option adds a supplementary column to the output flow where the normalized data are then standardized.

The Java library ANTLR is used to parse and tokenize the incoming data. For further information about ANTLR, see the site

http://www.antlr.org/

In local mode, Apache Spark 1.6, 2.0, 2.3, 2.4 and 3.0 are supported.

Note: This component is enhanced from the Studio version 7.3. If your indexes were created with version 7.2 or lower, you need to update them. The location of the migration procedure depends on the Studio installation:
  • With the installer: /addons/scripts/Lucene_Migration_Tool/README.md
  • With no installer: in the license email, click the link in Migration tool for Lucene Indexes from version 4 to version 8

For more technologies supported by Talend, see Talend components.