Configuring the preprocessing process - Cloud - 8.0

Text standardization
Version
Cloud
8.0
Language
English
Product
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Data Quality components > Standardization components > Text standardization components
Data Quality and Preparation > Third-party systems > Data Quality components > Standardization components > Text standardization components
Design and Development > Third-party systems > Data Quality components > Standardization components > Text standardization components

Procedure

  1. Double-click tNormalize to display its Basic settings view and define the component properties.
  2. From the Column to normalize list, select translation.
    This will split the data strings in the translation column into words.
  3. In the Item separator field, enter the separator which will delimits data in the translation column, a space character in this example.
  4. Double-click tFilterRow to display its Basic settings view and define the component properties.
  5. Select the logical operator you want to use in order to combine simple filtering and advanced mode.
  6. In the Conditions area, click the plus button to add one or more conditions to the output flow. And then in the corresponding table column:

    • select the input column you want to operate on,

    • select the needed function on the list,

    • select the operator to bind the input column with the value,

    • type in the value for content filtering.

      In this example, we want to filter all words in the translation column that have less than three letters.