Writing data to HDFS - 8.0

Talend Real-Time Big Data Platform Getting Started Guide
Version
8.0
Language
English
Operating system
Real-Time Big Data Platform
Product
Talend Real-Time Big Data Platform
Module
Talend Administration Center
Talend Installer
Talend Runtime
Talend Studio
Content
Data Quality and Preparation > Cleansing data
Data Quality and Preparation > Profiling data
Design and Development
Installation and Upgrade
Last publication date
2024-04-15

Procedure

  1. Double-click tAvroOutput to open its Component view.
  2. Ensure that the Define a storage configuration component check box is selected.
  3. In the Folder field, enter the path, or browse to the folder in which you want to write the data.
  4. From the Action list, select the operation you need to perform on the folder in question. If the folder already exists, select Overwrite; otherwise, select Create.
  5. Press F6 to run this Job.

Results

The statistics area in the workspace shows the progress of the processing of the generated datasets, segmented and counted as batches.

Once done, view the result in the web console of the HDFS system being used.

You can read that the basic_example- folder is continuously created and click to open one of them, you can see avro files written by this Job.

Note that not all the basic_example- folders contain actual data.