Scenario: Writing Avro data stream into HDFS - 6.5

Talend Real-Time Big Data Platform Getting Started Guide

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Real-Time Big Data Platform
task
Data Quality and Preparation > Cleansing data
Data Quality and Preparation > Profiling data
Design and Development
Installation and Upgrade
In this scenario, you created a very simple Spark Streaming Job. This Job will generate sample data stream by itself and write this stream in Avro format onto a given HDFS system.

Before replicating this scenario, ensure that you have appropriate rights and permissions to access the Hadoop distribution to be used.