Writing Avro data to ProducerRecord - Cloud - 8.0

Kafka
Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Messaging components (Integration) > Kafka components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Messaging components (Integration) > Kafka components
Last publication date
2024-02-29

About this task

Configure the writing Job.

Procedure

  1. From the writing Job, double-click the tFixedFlowInput component to open its Basic settings view and specify the following parameters:
    1. Click the […] button next to Edit schema to open the Schema dialog box.
    2. Click the [+] button to add a column and give a name to the column. For example:
    3. Click OK to validate these changes and accept the propagation prompted by the pop-up dialog box.
    4. Select Use Single Table in the Mode area and specify the value for each column.
  2. Double-click the tJavaRow component to open its Basic settings view and specify the following parameter:
    1. In the Code field, enter the Java code to extract the content. For example: 
      org.apache.kafka.clients.producer.ProducerRecord record = new org.apache.kafka.clients.producer.ProducerRecord(
		input_row.topic,
		input_row.partition,
		input_row.timestamp,
		input_row.key,
		input_row.value
);

record.headers().add("header1", input_row.header1);
record.headers().add("header2", input_row.header2);

output_row.record = record;
  3. Double-click the tKafkaOutput component to open its Basic settings view and specify the following parameters:
    1. From the Input type drop-down list, select ProducerRecord.
    2. From the Version drop-down list, select the version of the Kafka cluster to be used.
    3. In the Broker list field, enter the address of the broker nodes of the Kafka cluster to be used.

Results

The writing Job is configured.