Working with Amazon Kinesis and Big Data Streaming Jobs

Kinesis

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Data Fabric
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Messaging components (Integration) > Kinesis components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kinesis components
Design and Development > Third-party systems > Messaging components (Integration) > Kinesis components
EnrichPlatform
Talend Studio

This scenario shows how to work with Amazon Kinesis and Big Data Streaming Jobs using the Spark Streaming framework.

For more technologies supported by Talend, see Talend components.

This scenario applies only to Talend Real Time Big Data Platform and Talend Data Fabric.

This example uses Talend Real-Time Big Data Platform v6.1. In addition, it uses these licensed products provided by Amazon: Amazon EC2, Amazon Kinesis, and Amazon EMR.

In this example, you will build the following Job, to read and and write data to an Amazon Kinesis stream and display results in the Console.