Writing data to HDFS

Talend Data Fabric Getting Started Guide

author
Talend Documentation Team
EnrichVersion
6.4
EnrichProdName
Talend Data Fabric
task
Design and Development
Installation and Upgrade
Data Quality and Preparation > Profiling data
Data Quality and Preparation > Cleansing data

Procedure

  1. Double-click tAvroOutput to open its Component view.
  2. Ensure that the Define a storage configuration component check box is selected.
  3. In the Folder field, enter the path, or browse to the folder in which you want to write the data.
  4. From the Action list, select the operation you need to perform on the folder in question. If the folder already exists, select Overwrite; otherwise, select Create.
  5. Press F6 to run this Job.

Results

The statistics area in the workspace shows the progress of the processing of the generated datasets, segmented and counted as batches.

Once done, view the result in the web console of the HDFS system being used.

You can read that the basic_example- folder is continuously created and click to open one of them, you can see avro files written by this Job.

Note that not all the basic_example- folders contain actual data.