Kafka properties

Kafka properties - Cloud

Talend Cloud Apps Connectors Guide

Version

Cloud

Language

English

Product

Talend Cloud

Module

Talend Data Inventory

Talend Data Preparation

Talend Pipeline Designer

Content

Administration and Monitoring > Managing connections

Design and Development > Designing Pipelines

Last publication date

2024-03-21

Properties to configure to connect to a Kafka cluster. Supported Kafka versions are v0.10.0.x to v1.1.x.

Kafka connection

Property		Configuration
Selection		Select or enter Kafka.
Configuration
Engine		Select your engine in the list.
Connection	Bootstrap servers	Enter the addresses of the broker nodes of the Kafka cluster to be used. Example: `kafka1.example.com:9092` If you need to specify several addresses, separate them using a comma.
	Use SSL	Toggle this option ON to enable the SSL encrypted connection: In the Truststore type list, select the Truststore type to be used. In the Truststore path field, enter the path to the certificate TrustStore file (including file name) that contains the list of certificates that the client trusts. In the Truststore password field, enter the password used to check the integrity of the TrustStore data. By default, the Verify hostname toggle is ON. (Optional) You can toggle the Need client auth ON to validate the customer data. To do so, fill the following parameters: In the KeyStore type list; select the type of the keystore to be used. It may be PKCS 12 or JKS. In the Keystore path field, enter the path to the certificate TrustStore file (including file name) that contains the keystore data. In the Keystore password field, enter the password for this keystore.
	Use SASL	Toggle this option ON to enable the SASL encrypted connection. In the JAAS config field, enter the Java Authentication and Authorization Service login module to be used. In the SASL login class field (optional), enter the login class (for clients and brokers). In the SASL login callback handler class field (optional), enter the login callback handler class (for clients and brokers). In the SASL client callback handler class field (optional), enter the client callback handler class (for clients and brokers using SASL for inter-broker communication). In the SASL type list, select the authentication mechanism to be used. For more information, read the SASL configuration documentation.
Description		Enter a display name (mandatory) and a description (optional) for the connection.

Kafka dataset

Property		Configuration
Dataset name		Enter a display name for the dataset. This name will be used as a unique identifier of the dataset in all Talend Cloud apps.
Connection		Select your connection in the list. If you are creating a dataset based on an existing connection, this field is read-only.
Topic name		Enter or select the name of the topic (file) to be retrieved.
Value format		Select in the list the format of the data to be retrieved: Avro: If you select this format, you need to enter the schema of the Avro records to be retrieved. CSV: If you select this format, you need to indicate the type of field delimiter used in the file. JSON: No specific parameters required for this format.