Big Data: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Support of Spark Universal 3.2.x in Local mode | You can now run your Spark Batch and Streaming Jobs using Spark Universal
with Spark 3.2.x in Local mode. You can configure it either
in the Spark Configuration view of your Spark Jobs or in
the Hadoop Cluster Connection metadata wizard. Talend Data Mapper Big Data components (tHConvertFile, tHMapFile, tHMapInput and tHMapRecord) are now compatible with Spark 3.2.x. When you select this mode, Talend Studio builds the Spark environment in itself at runtime to run the Job locally within Talend Studio. 
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Open Source Apache Spark Standalone cluster on Spark Universal 3.2.x | You can now run your Spark Batch and Streaming Jobs in
Standalone mode with Spark Universal 3.2.x. You can
configure it in the Spark Configuration view of your Spark
Jobs or in the Hadoop Cluster Connection metadata
wizard.
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Databricks runtime 10.x and onwards with GCP on Spark Universal 3.2.x | You can now run your Spark Batch and Streaming Jobs on transient and
interactive Databricks clusters on Google Cloud Platform (GCP) using Spark
Universal with Spark 3.2.x. You can configure it either in the Spark
Configuration view of your Spark Jobs or in the Hadoop
Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Databricks 10.x version. 
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x | You can now run your Spark Batch and Streaming Jobs on Cloudera Data
Engineering experience, on both AWS and Azure, using Spark Universal with Spark
3.2.x. You can configure it in the Spark Configuration view
of your Spark Jobs. When you select this mode, Talend Studio is compatible with CDE 1.15 version. 
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Redshift driver v2.x for Redshift components in Spark Jobs | You can now use Redshift driver v2.x for the following components in your
Spark Jobs:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
| Support of Canned ACL when configuring cluster logs for Databricks and S3 | You can now use Canned ACL to configure the permissions on buckets and
folders that contain cluster logs of your Spark Jobs ran on Databricks
distribution with S3. You can configure it in the Spark
Configuration view of your Spark Jobs.
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Data Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Support of custom Java KeyStore for Job artifact signature |
Talend Studio
now supports configuring
custom Java KeyStore for the Job artifact signature and signing Job
artifacts with the custom Java keystore before publishing them to Talend Cloud.
|
ⓘ Available in: Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric All Talend Cloud products and Talend Data Fabric |
| Git manual commit mode enabled by default | The Git manual commit mode is now enabled by default in Talend Studio. When creating a branch, the new branch inherits the Git commit mode of the source branch. 
|
ⓘ Available in: Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric All Talend Cloud products and Talend Data Fabric |
| HTML generation for child Jobs, Joblets, or Routelets along with the parent Job or Route | When generating documentation for a Job or Route, the documentation for its
child Jobs, Joblets or Routelets is also generated. You can navigate to the
documentation for the child Job, Joblet, or Routelet via its corresponding link in
the documentation for the Job or Route. For more information about generating documentation for a Job or Route, see Generating HTML documentation. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| New icon on the Component view to open online help | A new icon is now available on the Component view to
open the online documentation for the current component on Talend Help Center.
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| Support of Sybase 17 | This release provides support of Sybase 17. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| ADAL library replaced with MSAL library in Microsoft CRM components | Microsoft CRM components use MSAL library instead of ADAL library from this release on. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| New components to handle files on Azure Data Lake Storage Gen2 | This release provides three new Azure Data Lake Storage Gen2 components: tAzureAdlsGen2Delete, tAzureAdlsGen2Get, and tAzureAdlsGen2Put. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| Support of TLS and Active Directory authentication in Couchbase components | Couchbase components now support TLS and Active Directory authentication. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| Talend Studio UI enhancements | The following improvements have been made for Talend Studio
user interface:
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Data Quality: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Databricks with Apache Spark 3.1 | DQ components can run on Databricks with Apache Spark 3.1, except for tDataEncrypt and tDataDecrypt. |
ⓘ Available in: Big Data Platform Cloud API Services Platform Cloud Big Data Platform Cloud Data Fabric Cloud Data Management Platform Data Fabric Data Management Platform Data Services Platform MDM Platform Real-Time Big Data Platform All Talend Platform and Data Fabric products |
Application Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
|
Support of context parameters in tRESTClient dynamic settings |
It is now supported to use context parameters in tRESTClient dynamic settings. |
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
|
Automatic creation of the "body" parameter for POST/PUT operations when importing an API definition in tRESTRequest |
The "body" parameter for POST/PUT operations is now created automatically when importing an API definition in the tRESTRequest component. |
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
Continuous Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Talend CI Builder upgraded to version 8.0.5 |
Talend
CI Builder is upgraded from version 8.0.4 to version 8.0.5. Use Talend CI Builder 8.0.5 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| New CI parameters to configure custom Java KeyStore for Job artifact signature | The -Dsigner.path,
-Dsigner.keystore.password,
-Dsigner.key.password, and
-Dsigner.key.alias parameters are now available, which
allows you to configure custom Java KeyStore for the Job artifact signature when
building the Job artifact packages using the Maven package command, to prevent
accidental or malicious modification of your Job artifact. For more information, see CI builder-related Maven parameters. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
Enhancement of generateAllPoms to simplify the Maven package process for a main project with duplicated reference projects |
The process of generating POM files for your projects using the mvn
org.talend.ci:builder-maven-plugin:8.0.X:generateAllPoms command has
been enhanced. If a main project has duplicated reference projects:
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |