Supported Big Data platform distribution versions for Talend Jobs

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Regular Hadoop distributions and dynamic support for Hadoop distributions

To find the compatibility between regular Hadoop distributions and Talend-supported Big Data elements, click on a Big Data related element below.

Old versions of the supported Big Data platforms are being retired by their vendors. Talend ceases to support a version once this version reaches its date of end of support set by its vendor.

Talend and its community provide you with the convenience to keep using a version its vendor ceases to support in Talend products. For this reason, this version can be still listed in the following tables and available in the products but Talend stops providing support for this version.

Talend supports the minor versions of the distribution versions listed in the following tables.

Supported Hadoop distributions with HBase
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-
Cloudera	6.1.1	Yes
	The other 6.x versions - compatible through Dynamic Distributions	-
	7.1.1	Yes
	The other 7.1.x versions - compatible through Dynamic Distributions	-

Supported Hadoop distributions with HCatalog
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-
Cloudera	6.1.1	Yes
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	-

Supported Hadoop distributions with HDFS
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	-

Supported Hadoop distributions with Hive
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-
Cloudera	6.1.1	Yes
	The other 6.x versions - compatible through Dynamic Distributions	-
	7.1.1	Yes
	The other 7.1.x versions - compatible through Dynamic Distributions	-

Note: The Profiling perspective does not support the Embedded connection mode on Hive distributions. This mode is available mainly for test purposes done by Hadoop developers. The studio may not be able to run correctly with the embedded mode.

Supported Hadoop distributions with Sqoop
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	v3.1.4.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-
Cloudera	6.1.1	Yes
	The other 6.x versions - compatible through Dynamic Distributions	-
	7.1.1	Yes
	The other 7.1.x versions - compatible through Dynamic Distributions	-

Supported Hadoop distributions with Spark
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab
HDP	v3.1.4.12-1	-	v2.3 (deprecated)	Yes (YARN only)
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-	-	-
Cloudera	6.1.1	v2.4	v2.4	Yes (YARN only)
	The other 6.x versions - compatible through Dynamic Distributions	-	-	-
	7.1.1	v2.4	v2.4	Yes (YARN only)
	The other 7.1.x versions - compatible through Dynamic Distributions	-	-	-

Supported Hadoop distributions with Azure Data Lake Storage Gen2 (ADLS Gen2)
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab
HDP	v3.1.4.12-1	-	v2.3 (deprecated)	Yes (YARN only)
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-	-	-
Cloudera	6.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	The other 6.x versions - compatible through Dynamic Distributions	-	-	-

If you need information about the Big Data Cloud platforms supported by Talend with ADLS Gen2, see the following section called Supported Cloud Big Data platform distribution versions for Talend Jobs of your installation guide.

Supported Hadoop distributions with Kafka in Spark Streaming Jobs
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab	Kafka versions
HDP	v3.1.4.12-1	-	v2.3 (deprecated)	Yes (YARN only)	v2.x
HDP	The other 3.x versions - compatible through Dynamic Distributions Note: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	-	-	-	-
Cloudera	6.1.1	v2.4	v2.4	Yes (YARN only)	v2.x
	The other 6.x versions - compatible through Dynamic Distributions	-	-	-	-
	7.1.1	v2.4	v2.4	Yes (YARN only)	v2.x
	The other 7.1.x versions - compatible through Dynamic Distributions	-	-	-	-

Supported Hadoop distributions with Kudu in Spark Batch Jobs
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
Cloudera	7.1.1	-
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	-

Supported Hadoop distributions with Impala
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
Cloudera	7.1.1	-
Cloudera	The other 7.1.x versions - compatible through Dynamic Distributions	-

Supported Big Data platform distribution versions for Talend Jobs - Cloud

Talend Cloud Installation and Upgrade Guide

Regular Hadoop distributions and dynamic support for Hadoop distributions