Data Quality: new features - Cloud - 8.0

Talend Release Notes

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud API Services Platform
Talend Cloud Big Data
Talend Cloud Big Data Platform
Talend Cloud Data Fabric
Talend Cloud Data Integration
Talend Cloud Data Management Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Cloud API Designer
Talend Cloud API Tester
Talend Cloud Data Inventory
Talend Cloud Data Preparation
Talend Cloud Data Stewardship
Talend Cloud Management Console
Talend Cloud Pipeline Designer
Talend Data Preparation
Talend Data Stewardship
Talend Studio
Content
Installation and Upgrade
Release Notes

From Talend Studio 8.0, you must use the Feature manager to install DQ features and components.

Feature

Description

Available in

New Apache Spark version The DQ components now support Apache Spark 3.0.1 in local mode.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

Databricks support The DQ components now support Databricks 7.3 LTS on AWS and Azure.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

New component tMatchIndexPredict for Apache Spark Streaming has been added.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

tDataMasking/tDataUnmasking

tDataEncrypt/tDataDecrypt

These components now support Dynamic data type as input. The output data type is also Dynamic.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

tPersonator
  • The component now supports the Date and Long data types as input.
  • The new IP address input field lets you have details on the IP address such as the connection speed, country...

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

New tables in reports

Delivered in 7.3 R2021-10 monthly release

Two tables have been added to the reports to get details on the blocking and matching keys.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

SAP Hana

Delivered in 7.3 R2021-01 monthly release

SAP Hana is now supported for Table, View, and Calculation View schemas.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

tDataMasking/tDataUnmasking

Delivered in 7.3 R2020-11 monthly release

New bank account masking functions:
  • Mask account number and keep original country and bank code: This function masks IBAN and US bank account numbers. It keeps the original country and bank/branch code.
  • Unmask account number and keep original country and bank code: This function unmasks IBAN and US bank account numbers masked with the preceding function.
Two bank account masking functions have been renamed:
  • Mask account number and keep original country renamed to Mask bank code and account number and keep original country
  • Unmask account number and keep original country renamed to Unmask bank code and account number and keep original country

The bank account masking functions and Generate account number and keep original country now handle more national check digits. This means that, for the following countries, the output national check digits are conform to the corresponding country: Belgium, Bosnia, Croatia, Czech Republic, Estonia, France, Hungary, Italy, Mauritania, Monaco, Montenegro, Norway, Portugal, San Marino, Serbia, Slovakia, Slovenia, Spain, Timor-Leste, Tunisia.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products

New phone number statistics indicator

Delivered in 7.3 R2020-10 monthly release

The new Valid Phone Number for Region Count indicator computes the phone numbers that are recognized as valid for a certain region.

Available in:

Big Data Platform

Cloud API Services Platform

Cloud Big Data Platform

Cloud Data Fabric

Cloud Data Management Platform

Data Fabric

Data Management Platform

Data Services Platform

MDM Platform

Real-Time Big Data Platform

All Talend Platform and Data Fabric products