Using secured Kafka with Studio

EnrichVersion
6.4
EnrichProdName
Talend Real-Time Big Data Platform
Talend Data Fabric
Talend Big Data Platform
Talend Big Data
Talend Open Studio for Big Data
task
Data Governance > Third-party systems > Authentication components
Data Quality and Preparation > Third-party systems > Authentication components
Design and Development > Third-party systems > Authentication components
Data Governance > Third-party systems > Authentication components > Kerberos components
Data Governance > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Messaging components (Integration) > Kafka components
Data Quality and Preparation > Third-party systems > Messaging components (Integration) > Kafka components
Design and Development > Third-party systems > Authentication components > Kerberos components
Data Quality and Preparation > Third-party systems > Authentication components > Kerberos components
EnrichPlatform
Talend Studio

Using secured Kafka in Studio

You can use secured Kafka with Talend Studio, but not all security options are supported with all versions of Kafka. The matrix of supported versions depends on the kind of job, the Talend version and the Kafka version.

This article provides the matrix of which Kerberos/SSL options are supported with different Kafka and Talend versions.

Environment

  • This matrix applies to Talend Studio v6.2 and later.
  • The Kafka components on Spark are available only with Talend Real-Time Big Data Platform and Talend Data Fabric subscriptions.

Support Matrix

Supported security options are in the cells.

 

Talend v6.2

Talend v6.3

 

Kafka 0.9

Kafka 0.9

Kafka 0.10

Standard Jobs

Kerberos

Kerberos

Kerberos

SSL

SSL

SSL

Spark 1.6

-

-

-

Spark 2.0

-

SSL

SSL

Currently, Spark does not have the API required to work with Kerberized Kafka.

To confirm which Kafka version your Spark Job is using, look in the Kafka-related package of the Spark module of your Hadoop distribution. Your Spark Job will use the Kafka version defined there.