tSqoopMerge - 7.3

Sqoop

Version
7.3
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Database tools > Sqoop components
Data Governance > Third-party systems > Data management components > Data movement > Sqoop components
Data Quality and Preparation > Third-party systems > Database tools > Sqoop components
Data Quality and Preparation > Third-party systems > Data management components > Data movement > Sqoop components
Design and Development > Third-party systems > Database tools > Sqoop components
Design and Development > Third-party systems > Data management components > Data movement > Sqoop components
Last publication date
2024-02-21

Performs an incremental import that updates an older dataset with newer records. The file types of the newer and the older datasets must be the same.

tSqoopMerge reads two datasets in HDFS and combines them both using a merge class that is able to parse the datasets, with the newer records overwriting the older records.

Note:

Sqoop is typically installed in every Hadoop distribution. But if the Hadoop distribution you need to use have no Sqoop installed, you have to install one on your own and ensure to add the Sqoop command line to the PATH variable of that distribution. For further information about how to install Sqoop, see the documentation of Sqoop.

For more technologies supported by Talend, see Talend components.