Big Data: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Support of latest Delta Lake API versions |
Talend Studio
now supports the following Delta Lake API versions to be aligned with latest
supported Databricks runtime versions:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Google Dataproc 2.0.x on Spark Universal 3.1.x with Hive components in Standard Jobs | You can now run your Standard Jobs containing Hive components on a Google
Dataproc cluster using Spark Universal with Spark 3.1.x. You can configure it in
the Basic settings view of the following Hive
components:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Databricks runtime 10.x and onwards on Spark Universal 3.2.x | You can now run your Spark Batch and Streaming Jobs on transient and
interactive Databricks clusters, both on AWS and Azure, using Spark Universal with
Spark 3.2.x. You can configure it either in the Spark
Configuration view of your Spark Jobs or in the Hadoop
Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Databricks 10.x version. 
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of CDP Private Cloud Base with Knox and Impala in Standard Jobs | If you use CDP Private Cloud Base to run your Standard Jobs, you can now make use of both Knox and Impala. |
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Possibility to open other Spark Batch and Streaming Jobs/Joblets versions in Talend Studio | You now have the possibility to open another version of your Spark Batch and
Streaming Jobs and Joblets in Talend Studio.
The Open another version option is available in the
Repository tree view when you right-click the Spark Job
or Joblet and it allows you to access older versions or to create a new one.
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Data Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
|
Management of Studio update settings from Talend Cloud Management Console |
The update settings of Talend Studio
can now be managed by your administrator from Talend Cloud Management Console. Talend Studio
can automatically retrieve the update settings that your administrator configured
in Talend Cloud Management Console
when logging into a project managed by Talend Cloud Management Console. For more information, see Configuring update repositories. 
|
ⓘ Available in: Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric All Talend Cloud products and Talend Data Fabric |
| Enhancement of the database connection wizard to support the prompt functionality on context variables | The database connection metadata wizard has been enhanced to support the
prompt functionality on context variables. This allows you to edit first the value
of any context variable, on which the prompt functionality is enabled, for a
database connection parameter when performing an operation which requires the
database connection. Note: It is not supported for HBase,
Hive, and Impala.
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| Support multi-line input for credential properties of components and metadata wizards created in the Talend Component Kit framework |
Talend Studio
now provides the following two modes for entering the value of a credential
property for components and metadata wizards created in the Talend
Component Kit framework.
For more information about the Talend Component Kit framework and the components and metadata wizards created in this framework, see Developing a component using Talend Component Kit. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
Enhancement of tSAPTableInput to support multi-table query with Talend SAP RFC Server using dynamic schema |
This release provides a dynamic schema enhancement, through which tSAPTableInput supports multi-table query with Talend SAP RFC Server. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
Support of zip4j 2.x libraries in tFileArchive and tFileUnarchive |
tFileArchive and tFileUnarchive support zip4j 2.x libraries. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
Enhancements in tFileOutputJSON and tWriteJSONField to support dynamic datatype and avoid scientific notation |
This release provides the following two enhancements for tFileOutputJSON and tWriteJSONField components.
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
HttpClient library upgraded to version 4.5.13 in tFileFetch |
HttpClient library is upgraded to version 4.5.13 in tFileFetch. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Data Quality: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Apache Spark 3.1 in local mode | DQ components support Apache Spark 3.1 in local mode, except for tMatchIndexPredict and tMatchIndex. |
ⓘ Available in: Big Data Platform Cloud API Services Platform Cloud Big Data Platform Cloud Data Fabric Cloud Data Management Platform Data Fabric Data Management Platform Data Services Platform MDM Platform Real-Time Big Data Platform All Talend Platform and Data Fabric products |
Application Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
|
New option in cSetHeader to remove headers |
A new option Headers to remove is added to the
cSetHeader component to remove message headers. 
|
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
Continuous Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Talend CI Builder is available from Talend repository from version 8.0.4 onwards | From version 8.0.4 onwards, Talend
CI Builder is available in the official Talend repository.
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
Support of CVE detection for Routes |
The detection of fixed CVEs for Route artifacts is now supported. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |