Scenario: Writing Avro data stream into HDFS - 7.0

Talend Data Fabric Getting Started Guide

author
Talend Documentation Team
EnrichVersion
7.0
EnrichProdName
Talend Data Fabric
task
Data Quality and Preparation > Cleansing data
Data Quality and Preparation > Profiling data
Design and Development
Installation and Upgrade
EnrichPlatform
Talend Administration Center
Talend DQ Portal
Talend Installer
Talend Runtime
Talend Studio
In this scenario, you created a very simple Spark Streaming Job. This Job will generate sample data stream by itself and write this stream in Avro format onto a given HDFS system.

Before replicating this scenario, ensure that you have appropriate rights and permissions to access the Hadoop distribution to be used.