tDataShuffling - Cloud - 8.0

Data privacy

Version
Cloud
8.0
Language
English
Product
Talend Big Data Platform
Talend Data Fabric
Talend Data Management Platform
Talend Data Services Platform
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Data Quality components > Data privacy components
Data Quality and Preparation > Third-party systems > Data Quality components > Data privacy components
Design and Development > Third-party systems > Data Quality components > Data privacy components
Last publication date
2024-03-28

Shuffles the data from in an input table to protect the actual data while having a functional data set. Data will remain usable for purposes such as testing and training.

tDataShuffling replaces original values with other values for the same column from a different row.

If you define one or several columns as the partition group, the whole table is split into a given number of partitions. These partitions share the same values in the columns partitioned. Then, the shuffling process is applied independently to each partition. All partitions are merged into one output table.

If you do not set columns as the partition group, the shuffling process is applied to the whole input table.

In local mode, Apache Spark 2.4.0 and later versions are supported.

This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see Installing features using the Feature Manager.

For more technologies supported by Talend, see Talend components.