What's new in R2022-11 - Cloud - 8.0

Talend Release Notes

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud API Services Platform
Talend Cloud Big Data
Talend Cloud Big Data Platform
Talend Cloud Data Fabric
Talend Cloud Data Integration
Talend Cloud Data Management Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Cloud API Designer
Talend Cloud API Tester
Talend Cloud Data Inventory
Talend Cloud Data Preparation
Talend Cloud Data Stewardship
Talend Cloud Pipeline Designer
Talend Data Preparation
Talend Data Stewardship
Talend Management Console
Talend Studio
Content
Installation and Upgrade
Release Notes
Last publication date
2024-02-13

Big Data: new features

Feature

Description

Available in

Support for Spark Universal 3.3.x in local mode

You can now run your Spark Batch and Streaming Jobs using Spark Universal with Spark 3.3.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support for Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x

You can now run your Spark Batch and Streaming Jobs on Cloudera Data Engineering experience, on both AWS and Azure, using Spark Universal with Spark 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs.

When you select this mode, Talend Studio is compatible with CDE 1.15 version.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Enhancement of tAvroInput to support dynamic schema in Spark Batch Jobs

You can now add a dynamic column to the schema of tAvroInput in your Spark Batch Jobs. The dynamic schema functionality allows you to configure a schema in a non-static way, so you will not have to redesign your Spark Job for future schema alteration while ensuring it will work all the time.

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Support for Databricks runtime 11.x with Spark Universal 3.3.x

You can now run your Spark Batch and Streaming Jobs on job and all-purpose Databricks clusters on Google Cloud Platform (GCP), AWS, and Azure using Spark Universal with Spark 3.3.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

When you select this mode, Talend Studio is compatible with Databricks 11.x version.

With this feature, there are known issues related to the following components:
  • tGSConfiguration does not work in Spark Streaming Jobs
  • tS3Configuration does not work as a storage component for tAvroInput when using AWS
  • tAzureFSConfiguration does not work as a storage component for tAvroInput when using Azure
  • tFileInputDelimited, tFileInputJSON, tFileInputParquet, tFileInputPositional, tFileInputRegex, and tFileInputXML do not work with tGSConfiguration when using GCP

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

Data Integration: new features

Feature

Description

Available in

Improved storage method for Git objects in local repositories (Beta) We introduce a new Git storage mode based on the standard Git storage and improve the way we store the Git objects for your repositories and projects. This helps save the disk space and allows you to use Git commands in Git tools to manage your repositories and projects. You will get a Git storage mode notification in the bottom right corner after you install the update.

The standard Git storage mode is disabled by default after installing the update. You can enable it via a new Enable the standard Git storage mode option in Talend Studio Preferences dialog box or by adding a new -Dgit.mode.standard parameter in the Talend Studio .ini file.

Warning: In a future release, the standard Git storage mode will be applied automatically, and the old customized Git storage mode will not be supported anymore.

For more information, see Enabling the standard Git storage mode.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Improved project analysis report to list invalid items The experimental project analysis tool in Talend Studio can now check if there are any invalid items in your project via a new InvalidItemsAnalysisTask task and list the invalid items in the analysis report.

For more information, see Analyzing projects.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New option to import direct dependencies when editing libraries for a routine, a bean, a custom routine jar, or a custom bean jar A new Add direct dependencies check box is provided in the Module dialog box when editing libraries for a global routine, a custom routine jar, a global bean, or a custom bean jar, which allows you to import direct dependencies of a library file or a POM file.

For more information, see Editing user routine libraries and Editing Bean libraries.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New option for ELT map components to enclose table and schema names with delimited characters in the generated SQL query A new Add quotes in table names when generating query check box is provided in the Property Settings dialog box in the ELT Map Editor of the tELTMap component, which allows you to add quotes for the table and schema names in the generated SQL query.

The Delimited identifiers check box in the Property Settings dialog box in the ELT Map Editor of all ELT map components except tELTSAPMap, which allows you to add quotes for the column names in the generated SQL query, is renamed to Add quotes in columns when generating query.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

MIMB OEM cumulative patch upgrade for Talend Metadata Bridge The MIMB OEM cumulative patch for Talend Metadata Bridge has been upgraded from MIMB-OEM-CumulativePatch-1010-20220622-1543.zip to MIMB-OEM-CumulativePatch-1100-20220926-1631.zip.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New timeout option in tKafkaCreateTopic

You can now set a timeout in milliseconds in the Advanced settings view of tKafkaCreateTopic.
This property is available for all Kafka versions:
  • for Kafka 2.2.1 and backwards versions, this property allows you to set values for both ZooKeeper session and connection timeouts
  • for Kafka 2.4.x and onwards versions, this property allows you to set the amount of time to wait for the result

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All subscription-based Talend products with Big Data

New OAuth flow in Microsoft CRM components to retrieve authentication token

The tMicrosoftCrmInput component and the tMicrosoftCrmOutput component support the Resource Owner Password Credentials (ROPC) authentication flow for retrieving the authentication token when the authentication type is ON_PREMISE and CRM version is CRM 2016. To use the ROPC authentication flow, select Resource Owner Password Credentials from the Flow drop-down list, set the token endpoint in the Token endpoint field, and enter OAuth resource URL in the Resource field (optional).

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Enhancement of tELTNetezzaOutput and tELTTeradataOutput to support merge operations

The tELTNetezzaOutput component and the tELTTeradataOutput component provide the Merge option in the Action on data drop-down list, allow you to perform merge insert, merge update, and merge delete data actions to entries in a database table.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New component to import data to a Neo4j 4.x database

This release provides the tNeo4jv4ImportTool component, allowing you to import data to a Neo4j 4.x database.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New messaging components to establish connections to Apache ActiveMQ and IBM WebSphere systems and perform commit and rollback operations

This release provides these messaging components: tMessagingClose, tMessagingCommit, tMessagingConnection, tMessagingInput, tMessagingOutput, and tMessagingRollback.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

Data Mapper: new features

Feature

Description

Available in

New FormatNumber function A new function allows you to create a string from a numeric value and format it using a specific pattern.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

Application Integration: new features

Feature

Description

Available in

New mediation components to facilitate schema and database operations

This release provides the following new mediation components:
  • cSQL: Reads any database using a SQL connection and extracts fields based on a query.
  • cSQLConnection: Opens a connection to the specified database that can then be reused in the subsequent subRoute.
  • cJsonParser: Extracts the desired data from JSON format.
  • cJsonWriter: Transforms the incoming data into JSON format.
  • cXmlParser: Extracts the desired data from XML format.
  • cXmlWriter: Transforms the incoming data into XML format.
  • cJsonValidator: Validates the data based on the given JSON schema.
  • cXmlValidator: Validates the data based on the given XML schema.

Available in:

Cloud API Services Platform

Cloud Data Fabric

Data Fabric

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with ESB

Automatic refresh of the Cloud Artifact view when selecting a Job or Route

The Cloud Artifact view is now updated automatically when selecting a Job or Route in the repository tree view.

Available in:

Cloud API Services Platform

Cloud Data Fabric

Data Fabric

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with ESB

Continuous Integration: new features

Feature

Description

Available in

Talend CI Builder upgraded to version 8.0.10 Talend CI Builder is upgraded from version 8.0.9 to version 8.0.10.

Use Talend CI Builder 8.0.10 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio

New parameter to discover all dependencies of filtered items

You can now use the parameter filter.include.dependencies to discover all dependencies of your project items during the POM generation step of the CI build. Only applies to the main project when the itemFilter parameter is used.

For more information, read the documentation.

Available in:

Big Data

Big Data Platform

Cloud API Services Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Integration

Cloud Data Management Platform

Data Fabric

Data Integration

Data Management Platform

Data Services Platform

ESB

MDM Platform

Real-Time Big Data Platform

All subscription-based Talend products with Talend Studio