Supported Big Data platform distribution versions for Talend Jobs - 7.2

Talend Open Studio for Data Quality Installation and Upgrade Guide for Linux

EnrichVersion
7.2
EnrichProdName
Talend Open Studio for Data Quality
task
Installation and Upgrade
EnrichPlatform
Talend Studio

Regular Hadoop distributions

To find the compatibility between regular Hadoop distributions and Talend-supported Big Data platforms, click on a Big Data platform below.

Supported Hadoop distributions with HBase
Hadoop distribution Version Works with HBase Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1 Yes Yes
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode)    
6.0.1 MEP 5.0 (YARN mode)    
6.1 / MEP 6.1    
Amazon EMR 3 4.5.0 (Apache 2.7.2)    
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with HCatalog
Hadoop distribution Version Works with HCatalog Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1 Yes Yes
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
6.1 / MEP 6.1 Yes Yes
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes Yes
4.6.0 (Apache 2.7.2) Yes Yes
5.0.0 (Apache 2.7.2) Yes Yes
5.5.0 (Apache 2.7.2) Yes Yes
5.8.0 (Apache 2.7.2) Yes Yes
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes Yes

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with HDFS
Hadoop distribution Version Works with HDFS Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1 Yes Yes
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
6.1 / MEP 6.1 Yes Yes
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes  
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with Hive
Hadoop distribution Version Works with Hive Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1 Yes Yes
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
6.1 / MEP 6.1 Yes Yes
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes  
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  
Note: The Profiling perspective does not support the Embedded connection mode on Hive distributions. This mode is available mainly for test purposes done by Hadoop developers. The studio may not be able to run correctly with the embedded mode.

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with Oozie
Hadoop distribution Version Works with Hive Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8    
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1    
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
6.1 / MEP 6.1    
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes  
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with Pig
Hadoop distribution Version Works with Pig Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1 Yes Yes
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
6.1 / MEP 6.1 Yes Yes
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes  
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with Sqoop
Hadoop distribution Version Works with Sqoop Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1 Yes Yes
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
6.1 / MEP 6.1 Yes Yes
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes  
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with Talend MapReduce
Hadoop distribution Version Works with Talend MapReduce Supports Kerberos Kinit and Keytab
HDP v2.4.0 Yes Yes
v2.5.0 Yes Yes
v2.6.0 Yes Yes
v2.6.0.3-8 Yes Yes
Cloudera 5.5 (YARN mode) Yes Yes
5.6 (YARN mode) Yes Yes
5.7 (YARN mode) Yes Yes
5.8 (YARN mode) Yes Yes
5.10 (YARN mode) Yes Yes
5.12.1 (YARN mode) Yes Yes
5.13.0 Yes Yes
6.1.1    
MapR 1, 2 5.0.0 (YARN mode) Yes Yes
5.1.0 (YARN mode) Yes Yes
5.2.0 (YARN mode) Yes Yes
6.0.0 (YARN mode) Yes Yes
6.0.1 MEP 5.0 (YARN mode) Yes Yes
Amazon EMR 3 4.5.0 (Apache 2.7.2) Yes  
4.6.0 (Apache 2.7.2) Yes  
5.0.0 (Apache 2.7.2) Yes  
5.5.0 (Apache 2.7.2) Yes  
5.8.0 (Apache 2.7.2) Yes  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) Yes  

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.

Supported Hadoop distributions with Spark
Hadoop distribution Version Works with Spark Stand-alone Works with Spark YARN Supports Kerberos Kinit and Keytab
HDP v2.4.0   v1.6 Yes (YARN only)
v2.5.0   v1.6 Yes (YARN only)
v2.6.0   v1.6 / v2.1 Yes (YARN only)
v2.6.0.3-8   v1.6 / v2.1 Yes (YARN only)
Cloudera 5.5 (YARN mode) v1.5 v1.5 Yes (YARN only)
5.6 (YARN mode) v1.5 v1.5 Yes (YARN only)
5.7 (YARN mode) v1.6 v1.6 Yes (YARN only)
5.8 (YARN mode) v1.6 v1.6 / v2.1 Yes (YARN only)
5.10 (YARN mode) v1.6 / 2.1 v1.6 / v2.1 Yes (YARN only)
5.12.1 (YARN mode) v2.2 v2.2 Yes (YARN only)
5.13.0 v2.2 v2.2 Yes (YARN only)
6.1.1 v2.4 v2.4 Yes (YARN only)
MapR 1, 2 5.0.0 (YARN mode) v1.3 v1.3 Yes (YARN only)
5.1.0 (YARN mode) v1.5 v1.5 Yes (YARN only)
5.2.0 (YARN mode) v1.6 v1.6 Yes (YARN only)
6.0.0 (YARN mode) v2.1 v2.1 Yes (YARN only)
6.0.1 MEP 5.0 (YARN mode) v2.2 v2.2 Yes (YARN only)
6.1 / MEP 6.1 v2.3 v2.3 Yes (YARN only)
Amazon EMR 3 4.5.0 (Apache 2.7.2)   v1.6  
4.6.0 (Apache 2.7.2)   v1.6  
5.0.0 (Apache 2.7.2)   v2.0  
5.5.0 (Apache 2.7.2)   v2.1  
5.8.0 (Apache 2.7.2)   v2.2  
5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2)   v2.3 Yes (YARN only)

1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.

2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.

3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.