Linking the components - 7.3

Kafka

EnrichVersion
Cloud
7.3
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
EnrichPlatform
Talend Studio
task
Data Governance > Third-party systems > Messaging components (Integration) > Kafka components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Messaging components (Integration) > Kafka components

Procedure

  1. In the Integration perspective of the Studio, create an empty Spark Streaming Job from the Job Designs node in the Repository tree view.
    For further information about how to create a Spark Streaming Job, see Talend Open Studio for Big Data Getting Started Guide .
  2. In the workspace, enter the name of the component to be used and select this component from the list that appears. In this scenario, the components are tHDFSConfiguration, tKafkaInput, tWindow, tExtractJSONFields, tMap, tAggregateRow, tTop and tLogRow.
  3. Connect tKafkaInput, tWindow, tExtractJSONFields and tMap using the Row > Main link.
  4. Connect tMap to tAggregateRow using the Row > Main link and name this connection in the dialog box that is displayed. For example, name it to hashtag.
  5. Connect tAggregateRow, tTop and tLogRow using the Row > Main link.
  6. Leave the tHDFSConfiguration component alone without any connection.