Configuring the schema registry connection - Cloud - 8.0

Kafka

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Data Governance > Third-party systems > Messaging components (Integration) > Kafka components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Messaging components (Integration) > Kafka components

About this task

You need to configure schema registry in Talend Studio to register information about schemas of the object, in that case Avro records. Make sure you have your environement set up and running on your computer to be able to use schema registry. For more information, see Installing and Configuring Schema Registry from the official Confluent documentation.

Procedure

  1. From the reading Job, double-click the tKafkaInput component and then go the Advanced settings view.
    Note: This configuration also applies to the tKafkaOutput component.
  2. Select the Use schema registry check box and provide the following parameters to connect to schema registry:
    • Url: enter the schema registry instance URL, in this example "https://localhost:8081".
    • Basic authentication: select this check box and enter your credentials in the Username and Password fields to authenticate to your schema registry instance.
    • Key deserializer: select Custom from the drop-down list and enter the following Avro deserializer "org.apache.kafka.common.serialization.ByteArrayDeserializer". For more information about supported Avro deserializer, see Avro Schema Serializer and Deserializer from the official Confluent documentation.
    • Value deserializer: select Avro from the drop-down list.
  3. Start schema registry on your computer. For more information, see Starting Schema Registry from the official Confluent documentation.