tDataShuffling - 7.3

Data privacy

Version
7.3
Language
English (United States)
Product
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Data Quality components > Data privacy components
Data Quality and Preparation > Third-party systems > Data Quality components > Data privacy components
Design and Development > Third-party systems > Data Quality components > Data privacy components

Shuffles the data from in an input table to protect the actual data while having a functional data set. Data will remain usable for purposes such as testing and training.

tDataShuffling replaces original values with other values for the same column from a different row.

If you define one or several columns as the partition group, the whole table is split into a given number of partitions. These partitions share the same values in the columns partitioned. Then, the shuffling process is applied independently to each partition. All partitions are merged into one output table.

If you do not set columns as the partition group, the shuffling process is applied to the whole input table.

In local mode, Apache Spark 1.4.0 and later versions are supported.

For more technologies supported by Talend, see Talend components.

Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks: