Generates a functional key from the input columns, by applying different types of algorithms on each column and grouping the computed results in one key, then outputs this key with the input columns.
tGenKey enables you to apply several kinds of algorithms on each input column and use the computed results to generate a functional key, which can be used, for example, to narrow down your data filter/matching results. These algorithms can be key or optional algorithms.
The values returned by the key algorithms will be concatenated, according to the column order in the Key composition table.
In local mode, Apache Spark 2.4.0 and later versions are supported.
This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.
For more technologies supported by Talend, see Talend components.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Standard: see tGenKey Standard properties.
The component in this framework is available in Talend Data Management Platform, Talend Big Data Platform, Talend Real Time Big Data Platform, Talend Data Services Platform, and in Talend Data Fabric.
-
Spark Batch: see tGenKey properties for Apache Spark Batch.
The component in this framework is available in all Talend Platform products with Big Data and in Talend Data Fabric.
-
Spark Streaming: see tGenKey properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.