Supported Cloud Big Data platform distribution versions for Talend Jobs - 8.0

Talend Open Studio for Big Data Installation and Upgrade Guide for Linux

Version
8.0
Language
English (United States)
EnrichDitaval
Open Studio for Big Data for Linux
Product
Talend Open Studio for Big Data
Module
Talend Studio
Content
Installation and Upgrade

Cloud Hadoop distributions

Talend supports the following cloud platforms for Big Data. Click your cloud platform to see the Big data support information.

Old versions of the supported Big Data platforms are being retired by their vendors. Talend ceases to support a version once this version reaches its date of end of support set by its vendor.

Talend and its community provide you with the convenience to keep using a version its vendor ceases to support in Talend products. For this reason, this version could be still listed in the following tables and available in the products but Talend stops providing support for this version.

Talend supports the minor versions of the platform versions listed in the following tables.

Amazon EMR
Amazon EMR version Supported frameworks Supported Hadoop elements in Spark batch Supported Hadoop elements in Spark streaming Supported Hadoop elements in Standard
v5.29.0 (Hadoop 2.8.5)

Standard

Spark v2.4

HBase

HDFS

HCatalog

Hive

HBase

HDFS

HCatalog

Hive

HBase

HDFS

HCatalog

Hive

Sqoop

v6.2.0 (Hadoop 3.2.1)

Standard

Spark v3.0

HBase

HDFS

HCatalog

Hive

HBase

HDFS

HCatalog

Hive

HBase

HDFS

HCatalog

Hive

Sqoop

The supported Amazon EMR version for the tAmazonEMRManage component is 5.29.0.

Databricks on AWS for Big Data
Databricks on AWS version Supported frameworks Supported elements in Spark batch Supported elements in Spark streaming Supported elements in Standard
5.5 LTS Standard

Spark v2.4

Hive

S3

DynamoDB

Snowflake

MongoDB

TDM components as technical preview

tDataprepRun

Hive

S3

DynamoDB

Kinesis

Snowflake

MongoDB

TDM components as technical preview

tDataprepRun

DBFS
6.4 Standard

Spark v2.4.5

Azure Blob Storage

ADLS Gen2

Snowflake

DeltaLake

Azure Blob Storage

ADLS Gen2

DBFS
7.3 LTS Standard

Spark v3.0.1

Hive

S3

DynamoDB

Snowflake

MongoDB

DeltaLake

ADLS Gen2

Azure Blob Storage

Hive

S3

DynamoDB

Snowflake

MongoDB

DeltaLake

ADLS Gen2

Kinesis

Azure Blob Storage

DBFS
Databricks on Azure for Big Data
Databricks on Azure version Supported frameworks Supported elements in Spark batch Supported elements in Spark streaming Supported elements in Standard
5.5 LTS Standard

Spark v2.4

Hive

Azure Blob Storage

ADLS Gen1

ADLS Gen2

Snowflake

DeltaLake

MongoDB

TDM components as technical preview

tDataprepRun

Hive

Azure Blob Storage

ADLS Gen1

ADLS Gen2

Snowflake

DeltaLake

MongoDB

TDM components as technical preview

tDataprepRun

DBFS
6.4 Standard

Spark v2.4.5

Azure Blob Storage

ADLS Gen2

Snowflake

DeltaLake

Azure Blob Storage

ADLS Gen2

DBFS
7.3 LTS Standard

Spark v3.0.1

Hive

S3

DynamoDB

Snowflake

MongoDB

DeltaLake

ADLS Gen1

ADLS Gen2

Azure Blob Storage

Hive

S3

DynamoDB

Snowflake

MongoDB

DeltaLake

ADLS Gen1

ADLS Gen2

Azure Blob Storage

DBFS
Microsoft HD Insight for Big Data
Microsoft HD Insight version Supported frameworks Supported elements in Spark batch Supported elements in Spark streaming Supported elements in Standard
4.0 Spark v2.4 ADLS Gen2

Azure Blob Storage

Hive

ADLS Gen2

Azure Blob Storage

Hive

ADLS Gen2

Azure Blob Storage

Hive