Scenario: Checking the existence of a file in HDFS

HDFS

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Real-Time Big Data Platform
Talend Big Data Platform
Talend Big Data
Talend Open Studio for Big Data
Talend Data Fabric
task
Design and Development > Third-party systems > File components (Integration) > HDFS components
Data Governance > Third-party systems > File components (Integration) > HDFS components
Data Quality and Preparation > Third-party systems > File components (Integration) > HDFS components
EnrichPlatform
Talend Studio

This scenario applies only to a Talend solution with Big Data.

For more technologies supported by Talend, see Talend components.

In this scenario, the two-component Job checks whether a specific file exists in HDFS and returns a message to indicate the result of the verification.

In the real-world practice, you can take further action to process the file checked according to the verification result, using the other HDFS components provided with the Studio.

Launch the Hadoop distribution in which you want to check the existence of a particular file. Then, proceed as follows: