Feature |
Description |
Available in |
---|---|---|
Support for HPE Ezmeral Runtime Enterprise 5.4 on Kubernetes with Spark 3.1.x | You can now run your Spark Batch and Streaming Jobs on Kubernetes with Livy
and Datatap using Spark Universal with Spark 3.1.x. |
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Support for Databricks 12.x runtime with Spark Universal 3.3.x | You can now run your Spark Batch and Streaming Jobs on all-purpose and job
clusters on Google Cloud Platform (GCP), AWS, and Azure using Spark Universal
with Spark 3.3.x. You can configure it either in the Spark
Configuration view of your Spark Jobs or in the
Hadoop Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Databricks 12.x version. |
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Support for Amazon EMR 6.8.0 and 6.9.0 with Spark Universal 3.3.x | You can now run your Spark Jobs on an Amazon EMR cluster using Spark
Universal with Spark 3.3.x in Yarn cluster mode. You can configure it either in
the Spark Configuration view of your Spark Jobs or in the
Hadoop Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Amazon EMR 6.8.0 and 6.9.0 versions. With the
Beta version for this feature, the following known issues exist with a
workaround:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Support for MongoDB v4+ for Spark Streaming 3.1 and onwards | Talend Studio now supports MongoDB v4+ with Spark 3.1 and onwards versions for the
following components in your Spark Streaming Jobs using Dataset:
With the Beta version for this feature, the MongoDB version to select from the DB Version drop-down list is MongoDB 3.2+. |
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |