Supported Big Data platform distribution versions for Talend Jobs

Regular Hadoop distributions and dynamic support for Hadoop distributions

To find the compatibility between regular Hadoop distributions and Talend-supported Big Data elements, click on a Big Data related element below.

Old versions of the supported Big Data platforms are being retired by their vendors. Talend ceases to support a version once this version reaches its date of end of support set by its vendor.

Talend and its community provide you with the convenience to keep using a version its vendor ceases to support in Talend products. For this reason, this version could be still listed in the following tables and available in the products but Talend stops providing support for this version.

Talend supports the minor versions of the distribution versions listed in the following tables.

Supported Hadoop distributions with HBase
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	6.1.1	Yes
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No

Supported Hadoop distributions with HCatalog
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	6.1.1	Yes
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No

Supported Hadoop distributions with HDFS
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	6.1.1	Yes
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No

Supported Hadoop distributions with Hive
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	6.1.1	Yes
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No

Restriction: The Profiling perspective does not support the Embedded connection mode on Hive distributions. This mode is available mainly for test purposes done by Hadoop developers. Talend Studio may not be able to run correctly with the embedded mode.

Supported Hadoop distributions with Sqoop
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.1.4.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	6.1.1	Yes
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No

Supported Hadoop distributions with Spark
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab
HDP	v3.1.4.12-1	No	v2.3	Yes (YARN only)
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No	No	No
Cloudera	6.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No	No	No
Cloudera	7.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No	v2.4 (YARN cluster only)	No

Supported Hadoop distributions with Azure Data Lake Storage Gen2 (ADLS Gen2)
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab
HDP	v3.1.4.12-1	No	v2.3	Yes (YARN only)
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No	No	No
Cloudera	6.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No	No	No

If you need information about the Big Data Cloud platforms supported by Talend with ADLS Gen2, see the following section called Supported Cloud Big Data platform distribution versions for Jobs.

Supported Hadoop distributions with Kafka in Spark Streaming Jobs
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab	Kafka versions
HDP	v3.1.4.12-1	No	v2.3	Yes (YARN only)	v2.x
HDP	The other 3.x versions - compatible through Dynamic Distributions	No	No	No	No
Cloudera	6.1.1	v2.4	v2.4	Yes (YARN only)	v2.x
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	No	No	No	No
Cloudera	7.1.1	v2.4	v2.4	Yes (YARN only)	v2.x
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No	No	No	No

Supported Hadoop distributions with Kudu in Spark Batch Jobs
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
Cloudera	7.1.1	No
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No

Supported Hadoop distributions with Impala
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
Cloudera	7.1.1	No
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	No

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!

Leave your feedback here