Skip to main content Skip to complementary content
Announcements

What's new in R2022-06

Big Data: new features

Feature

Description

Available in
Support of Spark Universal 3.2.x in Local mode You can now run your Spark Batch and Streaming Jobs using Spark Universal with Spark 3.2.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

Talend Data Mapper Big Data components (tHConvertFile, tHMapFile, tHMapInput, and tHMapRecord) are now compatible with Spark 3.2.x.

When you select this mode, Talend Studio builds the Spark environment in itself at runtime to run the Job locally within Talend Studio.

All subscription-based Talend products with Big Data
Support of Open Source Apache Spark Standalone cluster on Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs in Standalone mode with Spark Universal 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

All subscription-based Talend products with Big Data
Support of Databricks runtime 10.x and onwards with GCP on Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs on job and all-purpose Databricks clusters on Google Cloud Platform (GCP) using Spark Universal with Spark 3.2.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

When you select this mode, Talend Studio is compatible with Databricks 10.x version.

All subscription-based Talend products with Big Data
Support of Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs on Cloudera Data Engineering experience, on both AWS and Azure, using Spark Universal with Spark 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs.

When you select this mode, Talend Studio is compatible with CDE 1.15 version.

All subscription-based Talend products with Big Data
Support of Redshift driver v2.x for Redshift components in Spark Jobs You can now use Redshift driver v2.x for the following components in your Spark Jobs:
  • tRedshiftConfiguration
  • tRedshiftInput
  • tRedshiftOutput

All subscription-based Talend products with Big Data
Support of Canned ACL when configuring cluster logs for Databricks and S3 You can now use Canned ACL to configure the permissions on buckets and folders that contain cluster logs of your Spark Jobs ran on Databricks distribution with S3. You can configure it in the Spark Configuration view of your Spark Jobs.

All subscription-based Talend products with Big Data

Data Integration: new features

Feature

Description

Available in
Support of custom Java KeyStore for Job artifact signature Talend Studio now supports Configuring custom Java KeyStore for Job artifact signature and signing Job artifacts with the custom Java keystore before publishing them to Talend Cloud.

All Talend Cloud products and Talend Data Fabric
Git manual commit mode enabled by default The Git manual commit mode is now enabled by default in Talend Studio.

When creating a branch, the new branch inherits the Git commit mode of the source branch.

All Talend Cloud products and Talend Data Fabric
HTML generation for child Jobs, Joblets, or Routelets along with the parent Job or Route When generating documentation for a Job or Route, the documentation for its child Jobs, Joblets or Routelets is also generated. You can navigate to the documentation for the child Job, Joblet, or Routelet via its corresponding link in the documentation for the Job or Route.

For more information about generating documentation for a Job or Route, see Generating HTML documentation.

All subscription-based Talend products with Talend Studio
New icon on the Component view to open online help A new icon is now available on the Component view to open the online documentation for the current component on Talend Help Center.

All subscription-based Talend products with Talend Studio
Support of Sybase 17 This release provides support of Sybase 17.

All subscription-based Talend products with Talend Studio
ADAL library replaced with MSAL library in Microsoft CRM components Microsoft CRM components use MSAL library instead of ADAL library from this release on.

All subscription-based Talend products with Talend Studio
New components to handle files on Azure Data Lake Storage Gen2 This release provides three new Azure Data Lake Storage Gen2 components: tAzureAdlsGen2Delete, tAzureAdlsGen2Get, and tAzureAdlsGen2Put.

All subscription-based Talend products with Talend Studio
Support of TLS and Active Directory authentication in Couchbase components Couchbase components now support TLS and Active Directory authentication.

All subscription-based Talend products with Talend Studio
Talend Studio UI enhancements The following improvements have been made for Talend Studio user interface:
  • The Test option is selected by default in the Migrate projects or test dialog box when testing and applying a monthly update.
  • The Use local update settings check box is hidden in the Talend > Update settings view in the Preferences dialog box when you log into a project managed by Talend Management Console and the update settings are not configured in Talend Management Console.
  • The Eclipse Debug > Modules item is hidden in the Show View dialog box.

All subscription-based Talend products with Talend Studio

Data Quality: new features

Feature

Description

Available in
Databricks with Apache Spark 3.1 DQ components can run on Databricks with Apache Spark 3.1, except for tDataEncrypt and tDataDecrypt.

All Talend Platform and Data Fabric products

Application Integration: new features

Feature

Description

Available in

Support of context parameters in tRESTClient dynamic settings

It is now supported to use context parameters in tRESTClient dynamic settings.

All subscription-based Talend products with ESB

Automatic creation of the "body" parameter for POST/PUT operations when importing an API definition in tRESTRequest

The "body" parameter for POST/PUT operations is now created automatically when importing an API definition in the tRESTRequest component.

All subscription-based Talend products with ESB

Continuous Integration: new features

Feature

Description

Available in
Talend CI Builder upgraded to version 8.0.5 Talend CI Builder is upgraded from version 8.0.4 to version 8.0.5.

Use Talend CI Builder 8.0.5 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released.

All subscription-based Talend products with Talend Studio
New CI parameters to configure custom Java KeyStore for Job artifact signature The -Dsigner.path, -Dsigner.keystore.password, -Dsigner.key.password, and -Dsigner.key.alias parameters are now available, which allows you to configure custom Java KeyStore for the Job artifact signature when building the Job artifact packages using the Maven package command, to prevent accidental or malicious modification of your Job artifact.

For more information, see CI builder-related Maven parameters.

All subscription-based Talend products with Talend Studio

Enhancement of generateAllPoms to simplify the Maven package process for a main project with duplicated reference projects

 The process of generating POM files for your projects using the mvn org.talend.ci:builder-maven-plugin:8.0.X:generateAllPoms command has been enhanced. If a main project has duplicated reference projects:
  • The modules of the duplicated reference projects are now excluded from the POM files for the main project, and the artifacts in the duplicated reference projects are now installed into the Maven .m2 folder as dependencies by default.
  • You now do not need to add the -Dtalend.profile.mode parameter when generating POM files for the main project. For more information about the -Dtalend.profile.mode parameter, see CI builder-related Maven parameters.

All subscription-based Talend products with Talend Studio

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!

Leave your feedback here