Linking the components - 7.1

Kafka

author
Talend Documentation Team
EnrichVersion
7.1
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
task
Data Governance > Third-party systems > Messaging components (Integration) > Kafka components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Messaging components (Integration) > Kafka components
EnrichPlatform
Talend Studio

Procedure

  1. In the Integration perspective of the Studio, create an empty Spark Streaming Job from the Job Designs node in the Repository tree view.
    For further information about how to create a Spark Streaming Job, see Talend Open Studio for Big Data Getting Started Guide .
  2. In the workspace, enter the name of the component to be used and select this component from the list that appears. In this scenario, the components are tHDFSConfiguration, tKafkaInput, tWindow, tExtractJSONFields, tMap, tAggregateRow, tTop and tLogRow.
  3. Connect tKafkaInput, tWindow, tExtractJSONFields and tMap using the Row > Main link.
  4. Connect tMap to tAggregateRow using the Row > Main link and name this connection in the dialog box that is displayed. For example, name it to hashtag.
  5. Connect tAggregateRow, tTop and tLogRow using the Row > Main link.
  6. Leave the tHDFSConfiguration component alone without any connection.