What's new in R2022-06 - Cloud - 8.0

Talend Release Notes

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud API Services Platform
Talend Cloud Big Data
Talend Cloud Big Data Platform
Talend Cloud Data Fabric
Talend Cloud Data Integration
Talend Cloud Data Management Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Cloud API Designer
Talend Cloud API Tester
Talend Cloud Data Inventory
Talend Cloud Data Preparation
Talend Cloud Data Stewardship
Talend Cloud Pipeline Designer
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Talend Studio
Content
Installation and Upgrade
Release Notes
Last publication date
2024-02-13

Big Data: new features

Feature

Description

Available in

Support of Spark Universal 3.2.x in Local mode You can now run your Spark Batch and Streaming Jobs using Spark Universal with Spark 3.2.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

Talend Data Mapper Big Data components (tHConvertFile, tHMapFile, tHMapInput, and tHMapRecord) are now compatible with Spark 3.2.x.

When you select this mode, Talend Studio builds the Spark environment in itself at runtime to run the Job locally within Talend Studio.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support of Open Source Apache Spark Standalone cluster on Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs in Standalone mode with Spark Universal 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support of Databricks runtime 10.x and onwards with GCP on Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs on job and all-purpose Databricks clusters on Google Cloud Platform (GCP) using Spark Universal with Spark 3.2.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

When you select this mode, Talend Studio is compatible with Databricks 10.x version.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support of Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs on Cloudera Data Engineering experience, on both AWS and Azure, using Spark Universal with Spark 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs.

When you select this mode, Talend Studio is compatible with CDE 1.15 version.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support of Redshift driver v2.x for Redshift components in Spark Jobs You can now use Redshift driver v2.x for the following components in your Spark Jobs:
  • tRedshiftConfiguration
  • tRedshiftInput
  • tRedshiftOutput

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support of Canned ACL when configuring cluster logs for Databricks and S3 You can now use Canned ACL to configure the permissions on buckets and folders that contain cluster logs of your Spark Jobs ran on Databricks distribution with S3. You can configure it in the Spark Configuration view of your Spark Jobs.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Data Integration: new features

Feature

Description

Available in

Support of custom Java KeyStore for Job artifact signature Talend Studio now supports Configuring custom Java KeyStore for Job artifact signature and signing Job artifacts with the custom Java keystore before publishing them to Talend Cloud.

Available in:

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

All Talend Cloud products and Talend Data Fabric

Git manual commit mode enabled by default The Git manual commit mode is now enabled by default in Talend Studio.

When creating a branch, the new branch inherits the Git commit mode of the source branch.

Available in:

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

All Talend Cloud products and Talend Data Fabric

HTML generation for child Jobs, Joblets, or Routelets along with the parent Job or Route When generating documentation for a Job or Route, the documentation for its child Jobs, Joblets or Routelets is also generated. You can navigate to the documentation for the child Job, Joblet, or Routelet via its corresponding link in the documentation for the Job or Route.

For more information about generating documentation for a Job or Route, see Generating HTML documentation.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New icon on the Component view to open online help A new icon is now available on the Component view to open the online documentation for the current component on Talend Help Center.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Support of Sybase 17 This release provides support of Sybase 17.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

ADAL library replaced with MSAL library in Microsoft CRM components Microsoft CRM components use MSAL library instead of ADAL library from this release on.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New components to handle files on Azure Data Lake Storage Gen2 This release provides three new Azure Data Lake Storage Gen2 components: tAzureAdlsGen2Delete, tAzureAdlsGen2Get, and tAzureAdlsGen2Put.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Support of TLS and Active Directory authentication in Couchbase components Couchbase components now support TLS and Active Directory authentication.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Talend Studio UI enhancements The following improvements have been made for Talend Studio user interface:
  • The Test option is selected by default in the Migrate projects or test dialog box when testing and applying a monthly update.
  • The Use local update settings check box is hidden in the Talend > Update settings view in the Preferences dialog box when you log into a project managed by Talend Management Console and the update settings are not configured in Talend Management Console.
  • The Eclipse Debug > Modules item is hidden in the Show View dialog box.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Data Quality: new features

Feature

Description

Available in

Databricks with Apache Spark 3.1 DQ components can run on Databricks with Apache Spark 3.1, except for tDataEncrypt and tDataDecrypt.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

Application Integration: new features

Feature

Description

Available in

Support of context parameters in tRESTClient dynamic settings

It is now supported to use context parameters in tRESTClient dynamic settings.

Available in:

Cloud API Services Platform

Cloud Data Fabric

Data Fabric

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with ESB

Automatic creation of the "body" parameter for POST/PUT operations when importing an API definition in tRESTRequest

The "body" parameter for POST/PUT operations is now created automatically when importing an API definition in the tRESTRequest component.

Available in:

Cloud API Services Platform

Cloud Data Fabric

Data Fabric

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with ESB

Continuous Integration: new features

Feature

Description

Available in

Talend CI Builder upgraded to version 8.0.5 Talend CI Builder is upgraded from version 8.0.4 to version 8.0.5.

Use Talend CI Builder 8.0.5 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New CI parameters to configure custom Java KeyStore for Job artifact signature The -Dsigner.path, -Dsigner.keystore.password, -Dsigner.key.password, and -Dsigner.key.alias parameters are now available, which allows you to configure custom Java KeyStore for the Job artifact signature when building the Job artifact packages using the Maven package command, to prevent accidental or malicious modification of your Job artifact.

For more information, see CI builder-related Maven parameters.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Enhancement of generateAllPoms to simplify the Maven package process for a main project with duplicated reference projects

The process of generating POM files for your projects using the mvn org.talend.ci:builder-maven-plugin:8.0.X:generateAllPoms command has been enhanced. If a main project has duplicated reference projects:
  • The modules of the duplicated reference projects are now excluded from the POM files for the main project, and the artifacts in the duplicated reference projects are now installed into the Maven .m2 folder as dependencies by default.
  • You now do not need to add the -Dtalend.profile.mode parameter when generating POM files for the main project. For more information about the -Dtalend.profile.mode parameter, see CI builder-related Maven parameters.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio