What's new in R2021-09 - Cloud

What's new in R2021-09 - Cloud - 7.3

Talend Release Notes

Version

Cloud

7.3

Language

English

Product

Talend Big Data

Talend Big Data Platform

Talend Cloud API Services Platform

Talend Cloud Big Data

Talend Cloud Big Data Platform

Talend Cloud Data Fabric

Talend Cloud Data Integration

Talend Cloud Data Management Platform

Talend Data Fabric

Talend Data Integration

Talend Data Management Platform

Talend Data Services Platform

Talend ESB

Talend MDM Platform

Talend Real-Time Big Data Platform

Module

Talend Cloud API Designer

Talend Cloud API Tester

Talend Cloud Data Inventory

Talend Cloud Data Preparation

Talend Cloud Data Stewardship

Talend Cloud Pipeline Designer

Talend Data Preparation

Talend Data Stewardship

Talend Management Console

Talend Studio

Content

Installation and Upgrade

Release Notes

Last publication date

2024-03-20

Big Data: new features

Feature	Description	Available in
Different run modes available for Databricks Jobs	You can now choose how you want to run your Job on Databricks cluster when running a Spark Job with the new Run mode option. The Run mode option is available either in the Spark configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard. You can choose between the following two modes: Create and run now, allowing you to create and run immediately a Job on Databricks. With this mode, you can retrieve your Job with its ID in your Databricks workspace. Note: This mode was the default one automatically used before this release. Runs submit, allowing you to submit a one-time run without creating a Job on Databricks. With this mode, nothing is displayed in the user interface and no Job ID are created in your Databricks clusters. It avoids to create too many Job or to reuse an existing one, and thus avoid to reach the hour limit number of created Jobs in Databricks workspace.	ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All Talend products with Big Data
Support of Knox for CDP Public Cloud Data Hub	When you use a CDP Public Cloud Data Hub instance for your Spark Jobs, you can now authenticate using Knox with CDP 7.1 and onwards in YARN cluster and HDFS modes. The Use Knox check box is available either in the Spark configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard. For more information, see Setting up the Knox parameters with CDP Public Cloud Data Hub. Knox allows you to provide a single point of authentication only using SSO. This feature is now generally available.	ⓘ Available in: Big Data Big Data Platform Cloud Big Data Cloud Big Data Platform Cloud Data Fabric Data Fabric Real-Time Big Data Platform All Talend products with Big Data

Feature

Description

Available in

Different run modes available for Databricks Jobs

You can now choose how you want to run your Job on Databricks cluster when running a Spark Job with the new Run mode option. The Run mode option is available either in the Spark configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

You can choose between the following two modes:

Create and run now, allowing you to create and run immediately a Job on Databricks. With this mode, you can retrieve your Job with its ID in your Databricks workspace.
Note: This mode was the default one automatically used before this release.
Runs submit, allowing you to submit a one-time run without creating a Job on Databricks. With this mode, nothing is displayed in the user interface and no Job ID are created in your Databricks clusters. It avoids to create too many Job or to reuse an existing one, and thus avoid to reach the hour limit number of created Jobs in Databricks workspace.

ⓘ

Available in:

Big Data

Big Data Platform

Cloud Big Data

Cloud Big Data Platform

Cloud Data Fabric

Data Fabric

Real-Time Big Data Platform

All Talend products with Big Data

Support of Knox for CDP Public Cloud Data Hub

When you use a CDP Public Cloud Data Hub instance for your Spark Jobs, you can now authenticate using Knox with CDP 7.1 and onwards in YARN cluster and HDFS modes. The Use Knox check box is available either in the Spark configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard. For more information, see Setting up the Knox parameters with CDP Public Cloud Data Hub.

Knox allows you to provide a single point of authentication only using SSO.

This feature is now generally available.

ⓘ