Big Data - Cloud - 8.0

Talend Release Notes

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud API Services Platform
Talend Cloud Big Data
Talend Cloud Big Data Platform
Talend Cloud Data Fabric
Talend Cloud Data Integration
Talend Cloud Data Management Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Cloud API Designer
Talend Cloud API Tester
Talend Cloud Data Inventory
Talend Cloud Data Preparation
Talend Cloud Data Stewardship
Talend Cloud Pipeline Designer
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Talend Studio
Content
Installation and Upgrade
Release Notes
Last publication date
2024-04-16

Feature

Description

Available in

Support for Databricks runtime 13.x with Spark Universal 3.4.x You can now run your Spark Batch and Streaming Jobs on job and all-purpose Databricks clusters on Google Cloud Platform (GCP), AWS, and Azure using Spark Universal with Spark 3.4.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

When you select this mode, Talend Studio is compatible with Databricks 13.x version.

Spark Configuration view of a Spark Batch Job opened with Databricks mode in Spark 3.4.x highlighted.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support for CDP Private Cloud Base 7.1.9 Talend Studio now supports CDP Private Cloud Base 7.1.9 with Spark Universal 3.3.x in Spark Batch and Spark Streaming Jobs.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

New tIcebergCatalog component in Standard Jobs The tIcebergCatalog component is now available for your Standard Jobs, allowing you to configure a custom catalog with Hive or Hadoop.

A new check box is also available in tIcebergTable Basic settings view, Set catalog, allowing you to specify a catalog to be used to create the table into.

tIcebergTable Basic settings view opened with the Set catalog option selected.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support for INSERT OVERWRITE in tIcebergOutput in Standard Jobs The tIcebergOutput now supports the INSERT OVERWRITE feature in Standard Jobs. The new Use insert overwrite check box allows you either to replace all data from an Iceberg table with the All rows from source table option, or to replace data in an Iceberg table with the result of a custom query with the Use a custom query option.
tIcebergOutput Basic settings view opened with Use insert overwrite check box selected.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support for Azure Active Directory authentication for HDInsight Talend Studio now supports the Azure Active Directory authentication in your Spark Batch and Spark Streaming Jobs with both ADLS Gen2 and Azure storage. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.
Talend Studio is compatible with:
  • HDInsight 5.0 with Spark Universal 3.1.x
  • HDInsight 4.0 with Spark 2.3.x and 2.4.x
Spark Configuration view showing Azure Active Directory with HDInsight.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data