Linking the components - Cloud - 8.0

Kafka

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Messaging components (Integration) > Kafka components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Messaging components (Integration) > Kafka components

Procedure

  1. In the Integration perspective of the Studio, create two empty Standard Jobs from the Job Designs node in the Repository tree view.
  2. In the workspace, enter the name of the component to be used and select this component from the list that appears. In this scenario, the components are tKafkaInput, tJavaRow, tLogRow for the reading Job and tFixedFlowInput, tJavaRow, tKafkaOutput for the writing Job.
    The tFixedFlowInput component is used to load the sample data into the data flow. In the real-world practice, you can use other components such as tFileInputDelimited, alone or even with a tMap, in the place of tFixedFlowInput to design a sophisticated process to prepare your data to be processed.
  3. For the reading Job, connect tKafkaInput to tJavaRow and then connect tJavaRow to tLogRow using the Row > Main link.
  4. For the writing Job, connect tFixedFlowInput to tJavaRow and then connect tJavaRow to tKafkaOutput using the Row > Main link.

Results

The reading and writing Jobs are set up.