Writing data to HDFS

Procedure

Double-click tAvroOutput to open its Component view.
Ensure that the Define a storage configuration component check box is selected.
In the Folder field, enter the path, or browse to the folder in which you want to write the data.
From the Action list, select the operation you need to perform on the folder in question. If the folder already exists, select Overwrite; otherwise, select Create.
Press F6 to run this Job.

The statistics area in the workspace shows the progress of the processing of the generated datasets, segmented and counted as batches.

Once done, view the result in the web console of the HDFS system being used.

You can read that the basic_example- folder is continuously created and click to open one of them, you can see avro files written by this Job.

Note that not all the basic_example- folders contain actual data.

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!