What's new in R2020-11

Big Data: new features

Feature	Description	Available in
Pushdown predicate in SQL queries option	When you use the Query option to read data in Spark Batch Jobs, you can now use pushdown predicate in the SQL query to filter the data. It enables the optimization of SQL queries and the reduction of the processing time by filtering the data earlier. This feature is available for the following components: tRedshiftInput tJDBCInput tMysqlInput tTeradataInput	All Talend products with Big Data
Support of MapR with MEP 6.1.1	The MapR 6.1 with MEP 6.1.1 distribution is now supported with Spark v 2.3 for Data Integration, Spark Batch and Spark Streaming Jobs.	All Talend products with Big Data
Parameters prevalence for Hadoop cluster	When you connect a Job to a Hadoop cluster, the parameters set in the Spark configuration now prevail over the ones in the configuration JAR files.	All Talend products with Big Data
New button to browse Google credentials file	A button to browse Google credentials file now appears in the user interface of the Spark Configuration view and of the following components: tHiveConnection tHiveCreateTable tHiveRow tHiveLoad tHiveInput	All Talend products with Big Data

Data Integration: new features

Feature	Description	Available in
ELT Map components enhancement	All ELT Map components that support adding alias tables now allow you to rename aliases in the Map editor.	All Talend products with Talend Studio
Talend Studio login performance log enhancement	The name of the project you are logging onto can now be collected in Talend Studio login performance log.	All Talend products with Talend Studio
Default Git branch display	The default Git branch will appear as main, if any, instead of master in Talend Studio.	All Talend products with Talend Studio
Enhancement of editing routine/bean libraries	Talend Studio now supports displaying the Maven URI of each library when editing the libraries for a routine or a bean.	All Talend products with Talend Studio
tFileFetch: a new security option provided	The tFileFetch component provides the Trust all servers option for Https in the Advanced settings view. When this option is not selected, the component does not validate the server certificates.	All Talend products with Talend Studio
New components available	The following components are new in this release. tSingleStoreClose tSingleStoreCommit tSingleStoreConnection tSingleStoreInput tSingleStoreOutput tSingleStoreRollback tSingleStoreRow tSingleStoreSP Accordingly, the `Mapping SingleStore` option is provided in the Mapping drop-down list of the tELTMap and the tJDBCSCDELT components.	All Talend products with Talend Studio
tNeo4jv4Output: new options added for passing data in groups	The tNeo4jv4Output component provides the Send data as list option and the Data list name option, which group and pass incoming data in groups (known as lists).	All Talend products with Talend Studio

Data Quality: new features

Feature	Description	Available in
tDataMasking/tDataUnmasking	New bank account masking functions: Mask account number and keep original country and bank code: This function masks IBAN and US bank account numbers. It keeps the original country and bank/branch code. Unmask account number and keep original country and bank code: This function unmasks IBAN and US bank account numbers masked with the preceding function. Two bank account masking functions have been renamed: Mask account number and keep original country renamed to Mask bank code and account number and keep original country Unmask account number and keep original country renamed to Unmask bank code and account number and keep original country Important: For some countries, as the behavior of Mask/Unmask bank code and account number and keep original country has been updated from the 7.3 R2020-11 monthly version, you can only unmask bank account numbers masked from this monthly version. See the list of the impacted countries in the next paragraph. The bank account masking functions and Generate account number and keep original country now handle more national check digits. This means that, for the following countries, the output national check digits are conform to the corresponding country: Belgium, Bosnia, Croatia, Czech Republic, Estonia, France, Hungary, Italy, Mauritania, Monaco, Montenegro, Norway, Portugal, San Marino, Serbia, Slovakia, Slovenia, Spain, Timor-Leste, Tunisia.	All Talend Platform and Data Fabric products
tDataEncrypt/tDataDecrypt	These components now support `Dynamic` data type as input. The output data type is also `Dynamic`.	All Talend Platform and Data Fabric products

Feature

Description

Available in

tDataMasking/tDataUnmasking

New bank account masking functions:

Mask account number and keep original country and bank code: This function masks IBAN and US bank account numbers. It keeps the original country and bank/branch code.
Unmask account number and keep original country and bank code: This function unmasks IBAN and US bank account numbers masked with the preceding function.

Two bank account masking functions have been renamed:

Mask account number and keep original country renamed to Mask bank code and account number and keep original country
Unmask account number and keep original country renamed to Unmask bank code and account number and keep original country

Important: For some countries, as the behavior of Mask/Unmask bank code and account number and keep original country has been updated from the 7.3 R2020-11 monthly version, you can only unmask bank account numbers masked from this monthly version. See the list of the impacted countries in the next paragraph.

The bank account masking functions and Generate account number and keep original country now handle more national check digits. This means that, for the following countries, the output national check digits are conform to the corresponding country: Belgium, Bosnia, Croatia, Czech Republic, Estonia, France, Hungary, Italy, Mauritania, Monaco, Montenegro, Norway, Portugal, San Marino, Serbia, Slovakia, Slovenia, Spain, Timor-Leste, Tunisia.

All Talend Platform and Data Fabric products

tDataEncrypt/tDataDecrypt

These components now support Dynamic data type as input. The output data type is also Dynamic.