Big Data: new features
|
Feature |
Description |
Available in |
|---|---|---|
|
Support for Spark Universal 3.3.x in local mode |
You can now run your Spark Batch and Streaming Jobs using Spark Universal
with Spark 3.3.x in Local mode. You can configure it either in the
Spark Configuration view of your Spark Jobs or in the
Hadoop Cluster Connection metadata wizard. 
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
|
Support for Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x |
You can now run your Spark Batch and Streaming Jobs on Cloudera Data
Engineering experience, on both AWS and Azure, using Spark Universal with Spark
3.2.x. You can configure it in the Spark Configuration view
of your Spark Jobs. When you select this mode, Talend Studio is compatible with CDE 1.15 version. 
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
|
Enhancement of tAvroInput to support dynamic schema in Spark Batch Jobs |
You can now add a dynamic column to the schema of tAvroInput in your Spark
Batch Jobs. The dynamic schema functionality allows you to configure a schema in a
non-static way, so you will not have to redesign your Spark Job for future schema
alteration while ensuring it will work all the time.
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
|
Support for Databricks runtime 11.x with Spark Universal 3.3.x |
You can now run your Spark Batch and Streaming Jobs on job and all-purpose
Databricks clusters on Google Cloud Platform (GCP), AWS, and Azure using Spark
Universal with Spark 3.3.x. You can configure it either in the Spark
Configuration view of your Spark Jobs or in the Hadoop
Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Databricks 11.x version. With this feature, there
are known issues related to the following components:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Data Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Improved storage method for Git objects in local repositories (Beta) | We introduce a new Git storage mode based on the standard Git storage and
improve the way we store the Git objects for your repositories and projects. This
helps save the disk space and allows you to use Git commands in Git tools to
manage your repositories and projects. You will get a Git storage mode
notification in the bottom right corner after you install the update. The
standard Git storage mode is disabled by default after installing the update.
You can enable it via a new Enable the standard Git storage
mode option in Talend Studio
Preferences dialog box or by adding a new
Warning: In a future release,
the standard Git storage mode will be applied automatically, and the old
customized Git storage mode will not be supported anymore.
For more information, see Enabling the standard Git storage mode. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| Improved project analysis report to list invalid items | The experimental project analysis tool in Talend Studio
can now check if there are any invalid items in your project via a new
InvalidItemsAnalysisTask task and list the invalid items in
the analysis report.For more information, see Analyzing projects. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| New option to import direct dependencies when editing libraries for a routine, a bean, a custom routine jar, or a custom bean jar | A new Add direct dependencies check box is provided
in the Module dialog box when editing libraries for a
global routine, a custom routine jar, a global bean, or a custom bean jar, which
allows you to import direct dependencies of a library file or a POM file. For more information, see Editing user routine libraries and Editing Bean libraries. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| New option for ELT map components to enclose table and schema names with delimited characters in the generated SQL query | A new Add quotes in table names when generating query
check box is provided in the Property Settings dialog box
in the ELT Map Editor of the tELTMap component, which allows you to add quotes for
the table and schema names in the generated SQL query. The Delimited identifiers check box in the Property Settings dialog box in the ELT Map Editor of all ELT map components except tELTSAPMap, which allows you to add quotes for the column names in the generated SQL query, is renamed to Add quotes in columns when generating query. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| MIMB OEM cumulative patch upgrade for Talend Metadata Bridge | The MIMB OEM cumulative patch for Talend Metadata Bridge has been upgraded from MIMB-OEM-CumulativePatch-1010-20220622-1543.zip to MIMB-OEM-CumulativePatch-1100-20220926-1631.zip. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
|
New timeout option in tKafkaCreateTopic |
You can now set a timeout in milliseconds in the Advanced
settings view of tKafkaCreateTopic. This property is available
for all Kafka versions:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
New OAuth flow in Microsoft CRM components to retrieve authentication token |
The tMicrosoftCrmInput component and the tMicrosoftCrmOutput component support the Resource Owner Password Credentials (ROPC) authentication flow for retrieving the authentication token when the authentication type is ON_PREMISE and CRM version is CRM 2016. To use the ROPC authentication flow, select Resource Owner Password Credentials from the Flow drop-down list, set the token endpoint in the Token endpoint field, and enter OAuth resource URL in the Resource field (optional). 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Enhancement of tELTNetezzaOutput and tELTTeradataOutput to support merge operations |
The tELTNetezzaOutput component and the tELTTeradataOutput component provide the Merge option in the Action on data drop-down list, allow you to perform merge insert, merge update, and merge delete data actions to entries in a database table. 
|
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
New component to import data to a Neo4j 4.x database |
This release provides the tNeo4jv4ImportTool component, allowing you to import data to a Neo4j 4.x database. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
New messaging components to establish connections to Apache ActiveMQ and IBM WebSphere systems and perform commit and rollback operations |
This release provides these messaging components: tMessagingClose, tMessagingCommit, tMessagingConnection, tMessagingInput, tMessagingOutput, and tMessagingRollback. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Data Mapper: new features
|
Feature |
Description |
Available in |
|---|---|---|
| New FormatNumber function | A new function allows you to create a string from a numeric value and format it using a specific pattern. |
ⓘ Available in: Big Data Platform Cloud API Services Platform Cloud Big Data Platform Cloud Data Fabric Cloud Data Management Platform Data Fabric Data Management Platform Data Services Platform MDM Platform Real-Time Big Data Platform All Talend Platform and Data Fabric products |
Application Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
|
New mediation components to facilitate schema and database operations |
This release provides the following new mediation components:
|
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
|
Automatic refresh of the Cloud Artifact view when selecting a Job or Route |
The Cloud Artifact view is now updated automatically when selecting a Job or Route in the repository tree view. |
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
Continuous Integration: new features
|
Feature |
Description |
Available in |
|---|---|---|
| Talend CI Builder upgraded to version 8.0.10 | Talend
CI Builder is upgraded from version 8.0.9 to version 8.0.10. Use Talend CI Builder 8.0.10 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
| New parameter to discover all dependencies of filtered items | You can now use the parameter filter.include.dependencies to discover all dependencies of your project items during the POM generation step of the CI build. Only applies to the main project when the itemFilter parameter is used. For more information, read the documentation. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |