Big Data: new features
Feature |
Description |
Available in |
---|---|---|
Pushdown predicate in SQL queries option | When you use the Query option to read data in Spark
Batch Jobs, you can now use pushdown predicate in the SQL query to filter
the data. It enables the optimization of SQL queries and the reduction of
the processing time by filtering the data earlier. This feature is available
for the following components:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Support of MapR with MEP 6.1.1 | The MapR 6.1 with MEP 6.1.1 distribution is now supported with Spark v 2.3 for Data Integration, Spark Batch and Spark Streaming Jobs. |
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Parameters prevalence for Hadoop cluster | When you connect a Job to a Hadoop cluster, the parameters set in the Spark configuration now prevail over the ones in the configuration JAR files. |
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
New button to browse Google credentials file | A button to browse Google credentials file now
appears in the user interface of the Spark Configuration view and of the
following components:
|
ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All subscription-based Talend products with Big Data |
Data Integration: new features
Feature |
Description |
Available in |
---|---|---|
ELT Map components enhancement | All ELT Map components that support adding alias
tables now allow you to rename aliases in the Map editor. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Talend Studio login performance log enhancement | The name of the project you are logging onto can now
be collected in Talend Studio
login performance log. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Default Git branch display | The default Git branch will appear as main , if any, instead of master in Talend Studio. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Enhancement of editing routine/bean libraries |
Talend Studio now supports displaying the Maven URI of each library
when editing the libraries for a routine or a bean. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
tFileFetch: a new security option provided |
The tFileFetch component provides the Trust all servers option for Https in the Advanced settings view. When this option is not selected, the component does not validate the server certificates. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
New components available |
The following components are new in this release.
Accordingly, the Mapping SingleStore option is provided in the Mapping drop-down list of the tELTMap and the tJDBCSCDELT components. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
tNeo4jv4Output: new options added for passing data in groups |
The tNeo4jv4Output component provides the Send data as list option and the Data list name option, which group and pass incoming data in groups (known as lists). |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |
Data Quality: new features
Feature |
Description |
Available in |
---|---|---|
tDataMasking/tDataUnmasking | New bank account masking functions:
Two bank account masking functions have been renamed:
Important: For some countries, as the behavior of
Mask/Unmask bank code and account number
and keep original country has been updated from the 7.3
R2020-11 monthly version, you can only unmask bank account numbers masked
from this monthly version. See the list of the impacted countries in the
next paragraph.
The bank account masking functions and Generate account number and keep original country now handle more national check digits. This means that, for the following countries, the output national check digits are conform to the corresponding country: Belgium, Bosnia, Croatia, Czech Republic, Estonia, France, Hungary, Italy, Mauritania, Monaco, Montenegro, Norway, Portugal, San Marino, Serbia, Slovakia, Slovenia, Spain, Timor-Leste, Tunisia. |
ⓘ Available in: Big Data Platform Cloud API Services Platform Cloud Big Data Platform Cloud Data Fabric Cloud Data Management Platform Data Fabric Data Management Platform Data Services Platform MDM Platform Real-Time Big Data Platform All Talend Platform and Data Fabric products |
tDataEncrypt/tDataDecrypt | These components now support Dynamic data type as input. The output data type is also Dynamic. |
ⓘ Available in: Big Data Platform Cloud API Services Platform Cloud Big Data Platform Cloud Data Fabric Cloud Data Management Platform Data Fabric Data Management Platform Data Services Platform MDM Platform Real-Time Big Data Platform All Talend Platform and Data Fabric products |
Application Integration: new features
Feature |
Description |
Available in |
---|---|---|
Enhancement in database components to propagate values of context variables to data source alias |
It is possible now to propagate values of context
variables to the Data source alias
field of database components in Talend Studio which work in Talend Runtime. |
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
Enhancement in cConfig |
The cConfig component supports now custom GroupID and
artifact name. |
ⓘ Available in: Cloud API Services Platform Cloud Data Fabric Data Fabric Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with ESB |
Continuous Integration: new features
Feature |
Description |
Available in |
---|---|---|
Apply context group to parent and child Jobs - new parameters | You are now able to use the -Dtalend.job.context and -Dtalend.job.applyContextToChildren=true parameters when
building or scheduling the execution of Jobs in order to apply a specific
context group to all Jobs (parent and child Jobs) at build time. |
ⓘ Available in: Big Data Big Data Platform Cloud API Services Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Cloud Data Integration Cloud Data Management Platform Data Fabric Data Integration Data Management Platform Data Services Platform ESB MDM Platform Real-Time Big Data Platform All subscription-based Talend products with Talend Studio |