tGenKey - Cloud - 8.0

Identification

Version
Cloud
8.0
Language
English (United States)
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for ESB
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Data Quality components > Identification components
Data Quality and Preparation > Third-party systems > Data Quality components > Identification components
Design and Development > Third-party systems > Data Quality components > Identification components

Generates a functional key from the input columns, by applying different types of algorithms on each column and grouping the computed results in one key, then outputs this key with the input columns.

tGenKey enables you to apply several kinds of algorithms on each input column and use the computed results to generate a functional key, which can be used, for example, to narrow down your data filter/matching results. These algorithms can be key or optional algorithms.

The values returned by the key algorithms will be concatenated, according to the column order in the Key composition table.

In local mode, Apache Spark 2.4.0 and later versions are supported.

This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.

For more technologies supported by Talend, see Talend components.

Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:

  • Standard: see tGenKey Standard properties.

    The component in this framework is available in Talend Data Management Platform, Talend Big Data Platform, Talend Real Time Big Data Platform, Talend Data Services Platform, and in Talend Data Fabric.

  • Spark Batch: see tGenKey properties for Apache Spark Batch.

    The component in this framework is available in all Talend Platform products with Big Data and in Talend Data Fabric.

  • Spark Streaming: see tGenKey properties for Apache Spark Streaming.

    This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.