Regular Hadoop distributions
To find the compatibility between regular Hadoop distributions and Talend-supported Big Data platforms, click on a Big Data platform below.
| Hadoop distribution | Version | Works with HBase | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | Yes | Yes | |
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | |||
| 6.0.1 MEP 5.0 (YARN mode) | |||
| 6.1 / MEP 6.1 | |||
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | ||
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with HCatalog | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | Yes | Yes | |
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| 6.1 / MEP 6.1 | Yes | Yes | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | Yes |
| 4.6.0 (Apache 2.7.2) | Yes | Yes | |
| 5.0.0 (Apache 2.7.2) | Yes | Yes | |
| 5.5.0 (Apache 2.7.2) | Yes | Yes | |
| 5.8.0 (Apache 2.7.2) | Yes | Yes | |
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with HDFS | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | Yes | Yes | |
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| 6.1 / MEP 6.1 | Yes | Yes | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | |
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with Hive | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | Yes | Yes | |
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| 6.1 / MEP 6.1 | Yes | Yes | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | |
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with Hive | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | |||
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | |||
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| 6.1 / MEP 6.1 | |||
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | |
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with Pig | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | Yes | Yes | |
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| 6.1 / MEP 6.1 | Yes | Yes | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | |
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with Sqoop | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | Yes | Yes | |
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| 6.1 / MEP 6.1 | Yes | Yes | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | |
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with Talend MapReduce | Supports Kerberos Kinit and Keytab |
|---|---|---|---|
| HDP | v2.4.0 | Yes | Yes |
| v2.5.0 | Yes | Yes | |
| v2.6.0 | Yes | Yes | |
| v2.6.0.3-8 | Yes | Yes | |
| Cloudera | 5.5 (YARN mode) | Yes | Yes |
| 5.6 (YARN mode) | Yes | Yes | |
| 5.7 (YARN mode) | Yes | Yes | |
| 5.8 (YARN mode) | Yes | Yes | |
| 5.10 (YARN mode) | Yes | Yes | |
| 5.12.1 (YARN mode) | Yes | Yes | |
| 5.13.0 | Yes | Yes | |
| 6.1.1 | |||
| MapR 1, 2 | 5.0.0 (YARN mode) | Yes | Yes |
| 5.1.0 (YARN mode) | Yes | Yes | |
| 5.2.0 (YARN mode) | Yes | Yes | |
| 6.0.0 (YARN mode) | Yes | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) | Yes | Yes | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | Yes | |
| 4.6.0 (Apache 2.7.2) | Yes | ||
| 5.0.0 (Apache 2.7.2) | Yes | ||
| 5.5.0 (Apache 2.7.2) | Yes | ||
| 5.8.0 (Apache 2.7.2) | Yes | ||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab |
|---|---|---|---|---|
| HDP | v2.4.0 | v1.6 | Yes (YARN only) | |
| v2.5.0 | v1.6 | Yes (YARN only) | ||
| v2.6.0 | v1.6 / v2.1 | Yes (YARN only) | ||
| v2.6.0.3-8 | v1.6 / v2.1 | Yes (YARN only) | ||
| Cloudera | 5.5 (YARN mode) | v1.5 | v1.5 | Yes (YARN only) |
| 5.6 (YARN mode) | v1.5 | v1.5 | Yes (YARN only) | |
| 5.7 (YARN mode) | v1.6 | v1.6 | Yes (YARN only) | |
| 5.8 (YARN mode) | v1.6 | v1.6 / v2.1 | Yes (YARN only) | |
| 5.10 (YARN mode) | v1.6 / 2.1 | v1.6 / v2.1 | Yes (YARN only) | |
| 5.12.1 (YARN mode) | v2.2 | v2.2 | Yes (YARN only) | |
| 5.13.0 | v2.2 | v2.2 | Yes (YARN only) | |
| 6.1.1 | v2.4 | v2.4 | Yes (YARN only) | |
| MapR 1, 2 | 5.0.0 (YARN mode) | v1.3 | v1.3 | Yes (YARN only) |
| 5.1.0 (YARN mode) | v1.5 | v1.5 | Yes (YARN only) | |
| 5.2.0 (YARN mode) | v1.6 | v1.6 | Yes (YARN only) | |
| 6.0.0 (YARN mode) | v2.1 | v2.1 | Yes (YARN only) | |
| 6.0.1 MEP 5.0 (YARN mode) | v2.2 | v2.2 | Yes (YARN only) | |
| 6.1 / MEP 6.1 | v2.3 | v2.3 | Yes (YARN only) | |
| Amazon EMR 3 | 4.5.0 (Apache 2.7.2) | v1.6 | ||
| 4.6.0 (Apache 2.7.2) | v1.6 | |||
| 5.0.0 (Apache 2.7.2) | v2.0 | |||
| 5.5.0 (Apache 2.7.2) | v2.1 | |||
| 5.8.0 (Apache 2.7.2) | v2.2 | |||
| 5.15.0 (Hadoop 2.8.3).0 (Apache 2.7.2) | v2.3 | Yes (YARN only) |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
3. The supported Amazon EMR versions for the tAmazonEMRManage component are 4.0.0, 4.1.0, 4.2.0, 4.5.0, 4.6.0, 4.9.2 and 5.11.0.