Scenario: Writing Avro data stream into HDFS

Talend Data Fabric Getting Started Guide

author
Talend Documentation Team
EnrichVersion
6.4
EnrichProdName
Talend Data Fabric
task
Design and Development
Installation and Upgrade
Data Quality and Preparation > Profiling data
Data Quality and Preparation > Cleansing data
In this scenario, you created a very simple Spark Streaming Job. This Job will generate sample data stream by itself and write this stream in Avro format onto a given HDFS system.

Before replicating this scenario, ensure that you have appropriate rights and permissions to access the Hadoop distribution to be used.