tSqoopMerge - 6.5

Sqoop

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Database tools > Sqoop components
Data Quality and Preparation > Third-party systems > Database tools > Sqoop components
Design and Development > Third-party systems > Database tools > Sqoop components
EnrichPlatform
Talend Studio

Performs an incremental import that updates an older dataset with newer records. The file types of the newer and the older datasets must be the same.

tSqoopMerge reads two datasets in HDFS and combines them both using a merge class that is able to parse the datasets, with the newer records overwriting the older records.

Note:

Sqoop is typically installed in every Hadoop distribution. But if the Hadoop distribution you need to use have no Sqoop installed, you have to install one on your own and ensure to add the Sqoop command line to the PATH variable of that distribution. For further information about how to install Sqoop, see the documentation of Sqoop.

For more technologies supported by Talend, see Talend components.