Supported Hadoop distribution versions for Talend Jobs - 6.2

Talend Open Studio for Big Data Installation and Upgrade Guide for Mac

Version
6.2
Language
English (United States)
Product
Talend Open Studio for Big Data
Module
Talend Studio
Content
Installation and Upgrade

Hadoop distributions

  • : officially supported.

  • : not officially supported.

  • : the Kerberos kinit option is supported by the Studio.

  • : the Kerberos kinit option and the Kerberos keytab option are both supported by the Studio.

The information contained in the following table is applicable for the 6.2.2 version of your Talend product at the time of its release. For updated information on the latest supported software or databases, see this page.

This section lists only the distributions that are officially supported at the time of the release of the Studio. If support for the Hadoop distribution you want to use is not yet available in your Talend Studio, it may be available via an update. For related information, see Installing updates to incorporate the most recent Hadoop distributions.

 

HBase

HCatalog

HDFS

Hive

Oozie

Pig

Spark

Sqoop

Talend MapReduce

HiveServer1 2

HiveServer2 2

Standalone

YARN

HDP

V1.2.0 (Bimota)

V1.3.0 (Condor)

V2.0.0 (BigWheel)

V2.1.0 (Baikal)3

V2.2.03

V2.3.0

V2.4.0

Apache

1.0.0

0.92.0

0.9.0

ClouderaCDH4 (from 4.0 to 4.2)

CDH4.3 + (YARN mode)

CDH 5.0 (YARN mode)

CDH 5.1 (MR 1 mode)

CDH 5.1 (YARN mode)

CDH 5.4 (YARN mode)

CDH 5.5 (YARN mode)

CDH 5.6 (YARN mode)

CDH 5.7 (YARN mode)

MapR

2.0.0

2.1.2

2.1.3

3.0.1

3.1.0

4.0.1 (YARN mode)4

4.1.0 (YARN mode)4

5.0.0 (YARN mode)4

5.1.0 (YARN mode)4

Amazon EMR5

Apache 1.0.3

Apache 2.4.0

EMR 4.0.0 (Apache 2.6.0)

EMR 4.5.0 (Apache 2.7.2)

EMR 4.6.0 (Apache 2.7.2)

Pivotal HD

1.0.1

2.0

Microsoft HD Insight

3.1

3.2

3.4

Custom1

            

1. This enables the connection between the Studio and a custom Hadoop distribution not yet officially supported in the Studio. For further information, see the sections describing how to connect to a custom Hadoop distribution of the Talend Big Data Getting Started Guide or the documentation of any related component that creates the connection to a Hadoop distribution, such as tHDFSConnection.

2. In the Standalone mode, Hive 1 does not support the Kerberos security.

3. This option also allows you to connect to a Teradata Hadoop platform. For further information about the version of the Hortonworks Data Platform used in the Teradata platform you are using, see Teradata's related documentation.

4. For this MapR version, the MapR security ticket mechanism is supported by the Studio.

5. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0 and 4.6.0.

For further information about the versions of all the supported third-party systems/databases, see Supported systems, databases and business applications by Talend components.

Supported Cloudera Navigator versions

The support for Cloudera Navigator is available to the MapReduce or Spark Jobs you are creating in the Studio, which means you must be using a subscription-based Talend Big Data solution.

Studio version

Supported Cloudera Navigator version1

Compatible Cloudera Navigator versions2

Related Cloudera versions

6.2

2.4

2.5 to 2.6

5.5 to 5.7

The latest versions of Cloudera Navigator are not supported yet because of issues in Cloudera SDK. If you need to know more details about the Cloudera SDK versions and their compatible Navigator versions, see the Cloudera documentation about Cloudera Navigator SDK Version Compatibility.

  • 1: The term "supported" means Talend went through a complete QA validation process.

  • 2: The term "compatible" means Talend did not go through a complete QA validation process but the feature should work as part of Cloudera backward compatibility on Cloudera V5.X branches.