What's new in R2022-06 - Cloud

Talend Cloud Release Notes

Version
Cloud
Language
English (United States)
Product
Talend Cloud
Module
Talend API Designer
Talend API Tester
Talend Data Inventory
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Talend Pipeline Designer
Content
Installation and Upgrade
Release Notes

Big Data: new features

Feature

Description

Support of Spark Universal 3.2.x in Local mode You can now run your Spark Batch and Streaming Jobs using Spark Universal with Spark 3.2.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

Talend Data Mapper Big Data components (tHConvertFile, tHMapFile, tHMapInput and tHMapRecord) are now compatible with Spark 3.2.x.

When you select this mode, Talend Studio builds the Spark environment in itself at runtime to run the Job locally within the Studio.

Support of Open Source Apache Spark Standalone cluster on Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs in Standalone mode with Spark Universal 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.
Support of Databricks runtime 10.x and onwards with GCP on Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs on transient and interactive Databricks clusters on Google Cloud Platform (GCP) using Spark Universal with Spark 3.2.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

When you select this mode, Talend Studio is compatible with Databricks 10.x version.

Support of Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x You can now run your Spark Batch and Streaming Jobs on Cloudera Data Engineering experience, on both AWS and Azure, using Spark Universal with Spark 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs.

When you select this mode, Talend Studio is compatible with CDE 1.15 version.

Support of Redshift driver v2.x for Redshift components in Spark Jobs You can now use Redshift driver v2.x for the following components in your Spark Jobs:
  • tRedshiftConfiguration
  • tRedshiftInput
  • tRedshiftOutput
Support of Canned ACL when configuring cluster logs for Databricks and S3 You can now use Canned ACL to configure the permissions on buckets and folders that contain cluster logs of your Spark Jobs runned on Databricks distribution with S3. You can configure it in the Spark Configuration view of your Spark Jobs.

Data Integration: new features

Feature

Description

Support of custom Java KeyStore for Job artifact signature Talend Studio now supports configuring custom Java KeyStore for the Job artifact signature and signing Job artifacts with the custom Java keystore before publishing them to Talend Cloud.
Git manual commit mode enabled by default The Git manual commit mode is now enabled by default in Talend Studio.

When creating a branch, the new branch inherits the Git commit mode of the source branch.

HTML generation for child Jobs, Joblets, or Routelets along with the parent Job or Route When generating documentation for a Job or Route, the documentation for its child Jobs, Joblets or Routelets is also generated. You can navigate to the documentation for the child Job, Joblet, or Routelet via its corresponding link in the documentation for the Job or Route.

For more information about generating documentation for a Job or Route, see Generating HTML documentation.

New icon on the Component view to open online help A new icon is now available on the Component view to open the online documentation for the current component on Talend Help Center.
Support of Sybase 17 This release provides support of Sybase 17.
ADAL library replaced with MSAL library in Microsoft CRM components Microsoft CRM components use MSAL library instead of ADAL library from this release on.
New components to handle files on Azure Data Lake Storage Gen2 This release provides three new Azure Data Lake Storage Gen2 components: tAzureAdlsGen2Delete, tAzureAdlsGen2Get, and tAzureAdlsGen2Put.
Support of TLS and Active Directory authentication in Couchbase components Couchbase components now support TLS and Active Directory authentication.
Talend Studio UI enhancements The following improvements have been made for Talend Studio user interface:
  • The Test option is selected by default in the Migrate projects or test dialog box when testing and applying a monthly update.
  • The Use local update settings check box is hidden in the Talend > Update settings view in the Preferences dialog box when you log into a project managed by Talend Cloud Management Console and the update settings are not configured in Talend Cloud Management Console.
  • The Eclipse Debug > Modules item is hidden in the Show View dialog box.

Data Quality: new features

Feature

Description

Databricks with Apache Spark 3.1 DQ components can run on Databricks with Apache Spark 3.1, except for tDataEncrypt and tDataDecrypt.

Application Integration: new features

Feature

Description

Support of context parameters in tRESTClient dynamic settings

It is now supported to use context parameters in tRESTClient dynamic settings.

Automatic creation of the "body" parameter for POST/PUT operations when importing an API definition in tRESTRequest

The "body" parameter for POST/PUT operations is now created automatically when importing an API definition in the tRESTRequest component.

Continuous Integration: new features

Feature

Description

Talend CI Builder upgraded to version 8.0.5 Talend CI Builder is upgraded from version 8.0.4 to version 8.0.5.

Use Talend CI Builder 8.0.5 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released.

New CI parameters to configure custom Java KeyStore for Job artifact signature The -Dsigner.path, -Dsigner.keystore.password, -Dsigner.key.password, and -Dsigner.key.alias parameters are now available, which allows you to configure custom Java KeyStore for the Job artifact signature when building the Job artifact packages using the Maven package command, to prevent accidental or malicious modification of your Job artifact.

For more information, see CI builder-related Maven parameters.

Enhancement of generateAllPoms to simplify the Maven package process for a main project with duplicated reference projects

The process of generating POM files for your projects using the mvn org.talend.ci:builder-maven-plugin:8.0.X:generateAllPoms command has been enhanced. If a main project has duplicated reference projects:
  • The modules of the duplicated reference projects are now excluded from the POM files for the main project, and the artifacts in the duplicated reference projects are now installed into the Maven .m2 folder as dependencies by default.
  • You now do not need to add the -Dtalend.profile.mode parameter when generating POM files for the main project. For more information about the -Dtalend.profile.mode parameter, see CI builder-related Maven parameters.