Data Integration: new features - 7.3

Talend Big Data products Release Notes

author
Talend Documentation Team
EnrichVersion
7.3
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
task
Installation and Upgrade
Release Notes

Feature

Description

Product

Online help for components on pressing F1

Starting from Talend 7.3, by default, pressing F1 on a component will open the relevant documentation on Talend Help Center using the default Web browser.

To switch to offline help, go to Window > Preferences > Talend > Components and clear the Enable online help for components check box.

Before using offline help, subscription users need to install the Talend Help package by following the instructions when switching to offline help, or going to Help > Install Additional Packages.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Rotating encryption keys

Talend Studio now allows you to rotate the following two encryption keys by adding a new version of the key with an empty value in the encryption key configuration file.

  • the system encryption key: for encrypting properties and nexus passwords
  • the routine encryption key: for encrypting passwords of generated Jobs

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

New update mechanism

Talend Studio has improved the patch mechanism to handle monthly updates. You will be able to apply cumulative patches for bug fixes, new components, and new features provided by Talend.

After your administrator accepts a patch for Talend Studio in Talend Administration Center, Talend Studio will detect the new update automatically when opening a remote project.

Note that all Talend Studio clients connected to the same project must install the same patch. Otherwise, you cannot connect to the project successfully.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Log4j 2 support

Talend Studio now supports Apache logging utility Log4j 2 in components and allows you to enable or disable Log4j 2 loggers and customize the configuration globally for the project.

Note: If you need to deploy your Jobs to Talend Cloud, the use of Log4j 2 requires Talend Remote Engine 2.8.1 or higher. Otherwise, no log will be shown for those Jobs with Log4j 2 enabled.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Nexus Proxy settings

Talend Studio now allows you to configure a proxy for your artifact repository in the General > Artifact Proxy Setting view in the Project Settings dialog box if you are using a supported version of artifact repository instead of Talend Artifact Repository embedded with your Talend product.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Redshift SSO support with Ping Federate in metadata wizard

The Login and Password fields have been added in the Database Connection metadata wizard for Redshift SSO.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Metadata Bridge version upgrade

The version of Talend Metadata Bridge has been updated to 10.1.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

New components available

Two new components are now available: tSnowflakeCommit and tSnowflakeRollback.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

New component available

A new component, tWorkdayInput, is available in this release.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

New option available: Connection timeout

The Connection timeout option is added to the Advanced settings view.

Components concerned:

  • tFTPFileExist, tFTPPut, tFTPConnection, tFTPDelete, tFTPFilelist, tFTPFileProperties, tFTPGet, tFTPRename

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Excel 2007 xlsm support

This feature enables accesses to Excel 2007 files (with the extensions of .xlsx and .xlsm) through the Read excel2007 file format (xlsx / xlsm) and the Write excel2007 file format (xlsx / xlsm) options.

Components concerned:
  • tFileInputExcel, tFileOutputExcel

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Excel 2007 password support

This feature allows the tFileInputExcel component to read password-protected Excel 2007 (and later) files given that the passwords are available; it also allows the tFileOutputExcel component to set passwords for Excel 2007 (and later) files.

Components concerned:
  • tFileInputExcel, tFileOutputExcel

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tSetProxy: Https proxy with authentication

This feature allows for connections to a basic authentication-enabled Https proxy server through the Use authentication, Proxy user, Proxy password, and Enable Basic Authentication Header (in the Advanced settings view) options.

Component concerned:
  • tSetProxy

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tJDBCInput: prepared statements

This feature enables you to query a database using a prepared statement through the Use PreparedStatement option in the Advanced settings view.

Component concerned:
  • tJDBCInput

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

AWS server-side encryption (SSE) for SQS queues

Components concerned:
  • tSQSConnection, tSQSInput, tSQSMessageChangeVisibility, tSQSMessageDelete, tSQSOutput, tSQSQueueAttributes, tSQSQueueCreate, tSQSQueueDelete, tSQSQueueList, tSQSQueuePurge

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tPostgresqlOutput: new option available

The tPostgresqlOutput component provides the Convert column and table to lowercase option in the Advanced settings view, to put column names of newly created Postgres tables in lower case.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tServiceNowInput: combined filtering conditions

This feature allows for combined filtering conditions (combined with AND and OR operators) for retrieving data from ServiceNow through the Advanced Query field in the Advanced settings view.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tRunJob: customizable Child Job JVM argument

This feature provides the following two ways in the Advanced settings view for setting JVM arguments for the Job to be called or processed (Use dynamic job needs to be selected in the Basic settings view).
  • Use child job JVM arguments
  • Overwrite child job JVM arguments

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tJDBCSCDELT: End date configurable

This feature allows you to set the End date for type 2 SCD.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Access control list for S3 components

This feature allows you to set access control list (ACL) for the current component through the Access control option in the Advanced settings view.

Components concerned:
  • tS3Put
  • tS3BucketCreate

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Redshift Bulk components: reuse S3 connection

This feature enables Redshift components to reuse existing S3 connections.

Components concerned:
  • tRedshiftUnload, tRedshiftOutputBulk, tRedshiftOutputBulkExec, tRedshiftBulkExec

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tSetProxy: three new options provided for using proxy

The tSetProxy components provides the following three new options.

  • Use Java Virtual Machine Proxy Configuration
  • URIs to use proxy
  • Thread isolated proxy (in the Advanced settings view)

See Talend Components Reference Guide for related information.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Setting Kafka connections and configuring Azure EventHub as Kafka cluster

This feature enables you to set Kafka connections and configure an Azure EventHub as Kafka cluster.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Using a schema other than the schema of the connection

Through the Use alternate schema option in the Advanced settings view, this feature enables you to use a schema other than the one specified by the component that establishes the database connection (Use an existing connection needs to be selected in the Basic settings view).

Components concerned:
  • tAmazonOracleOutput
  • tRedshiftOutput
  • tGreenplumOutput
  • tDB2Output
  • tInformixOutput
  • tMSSqlOutput
  • tOracleOutput
  • tParAccelOutput
  • tPostgreSQLOutput
  • tPostgresPlusOutput
  • tSAPHanaOutput
  • tSybaseOutput
  • tVerticaOutput

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tSnowflakeConnection: key pair authentication

The tSnowflakeConnection component provides the key pair authentication.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Customizing SET clause

This feature generates SET clauses for update operations based on the columns you selected in the Clause SET table in the Advanced settings view (Update needs to be selected from the Action on data drop-down list in the Basic settings view).

Components concerned:
  • tELTTeradataOutput
  • tELTOutput

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Extending AWS ECS role support to other components

This feature makes instance profile credential valid both on Amazon EC2 instances and AWS ECS instances.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

SHA2 support

SFTP connection now supports SHA2 authentication algorithm.

Components concerned:

  • tFTPConnection
  • tFTPDelete
  • tFTPFileExist
  • tFTPFileList
  • tFTPFileProperties
  • tFTPGet
  • tFTPPut
  • tFTPRename
  • tFTPTruncate

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

New Amazon S3 region options

The following new Amazon S3 region options are provided:
  • US East (Ohio)
  • Asia Pacific (Hong Kong)
  • Asia Pacific (Seoul)
  • Canada (Central)
  • China (Ningxia)
  • EU (London)
  • EU (Paris)
  • EU (Stockholm)

Components concerned:

  • tRedshiftOutputBulk, tRedshiftOutputBulkExec
  • tS3BucketCreate, tS3BucketDelete, tS3BucketExist, tS3BucketList, tS3Connection, tS3Copy, tS3Delete, tS3Get, tS3List, tS3Put

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

New Amazon S3 region options

The following new Amazon S3 region options are provided:

  • US East (Ohio)
  • Asia Pacific (Hong Kong)
  • Asia Pacific (Seoul)
  • Canada (Central)
  • EU (London)
  • EU (Paris)
  • EU (Stockholm)

Components concerned: tSnowflakeOutputBulk, tSnowflakeOutputBulkExec, and tSnowflakeBulkExec

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tRedshiftBulkExec: the Assume Role option available to other data source types besides S3

For the tRedShiftBulkExec component, in addition to S3 data sources, the Assume Role option is now available to these data sources: EMR, DynamoDB, and Remote host. You can thus set IAM role ARN chains for these four types of data sources.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tSQLTemplateMerge: the Database Type drop-down list provides the Snowflake option

The tSQLTemplateMerge component now provides the Snowflake option in the Database Type drop-down list. In addition, the following system SQL templates are provided:
  • SnowflakeCreateSourceTable
  • SnowflakeCreateTargetTable
  • SnowflakeDropSourceTable
  • SnowflakeDropTargetTable
  • SnowflakeMerge

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

tAmazonEMRManage: cluster version upgrade

The tAmazonEMRManage component now supports the cluster version EMR 5.15.0, which is the default cluster version when configuring the component.

Besides, the support for EMR 4.2.0, EMR 4.1.0, and EMR 4.0.0 is dropped.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

ActiveMQ 5.15.10 support

Components concerned:

  • tMomCommit, tMomConnection, tMomInput, tMomMessageIdList, tMomOutput, tMomRollback
  • tSAPADSOInput, tSAPBApi, tSAPBWInput, tSAPCommit, tSAPConnection, tSAPDataSourceOutput, tSAPDataSourceReceiver, tSAPDSOInput, tSAPDSOOutput, tSAPIDocInput, tSAPIDocOutput, tSAPIDocReceiver, tSAPInfoCubeInput, tSAPInfoObjectInput, tSAPInfoObjectOutput, tSAPODPInput, tSAPRollback, tSAPTableInput

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Snowflake JDBC driver 3.11.x support

Components concerned in Standard Jobs:

  • tSnowflakeBulkExec, tSnowflakeClose, tSnowflakeConnection, tSnowflakeInput, tSnowflakeOutput, tSnowflakeOutputBulk, tSnowflakeOutputBulkExec, tSnowflakeRow

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Redshift JDBC driver 1.23.7.1061 support

Components concerned in Standard Jobs:

  • tRedshiftBulkExec, tRedshiftClose, tRedshiftCommit, tRedshiftConnection, tRedshiftInput, tRedshiftOutput, tRedshiftOutputBulk, tRedshiftOutputBulkExec, tRedshiftRollback, tRedshiftRow, tRedshiftUnload

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

MySQL driver 8.0.18 support (MySQL 4 support dropped)

Components concerned in Standard Jobs:

  • tMysqlCDC, tMysqlClose, tMysqlColumnlist, tMysqlCommit, tMysqlConnection, tMysqlInput, tMysqlInvalidRows, tMysqlLastInsertId, tMysqlOutput, tMysqlOutputBulk, tMysqlOutputBulkExec, tMysqlRollback, tMysqlRow, tMysqlSCD, tMysqlSCDELT, tMysqlSP,tMysqlTableList, tMysqlValidRows

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Vertica DB 9.3.1 support

Components concerned:

  • tVerticaBulkExec, tVerticaClose, tVerticaCommit, tVerticaConnection, tVerticaInput, tVerticaOutput, tVerticaOutputBulk, tVerticaOutputBulkExec, tVerticaRollback, tVerticaRow, tVerticaSCD

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Postgres 12.1 support

Components concerned:

  • tPostgresqlCDC, tPostgresqlClose, tPostgresqlCommit, tPostgresqlConnection, tPostgresqlInput, tPostgresqlInvalidRows, tPostgresqlOutput, tPostgresqlOutputBulk, tPostgresqlOutputBulkExec, tPostgresqlRollback, tPostgresqlRow, tPostgresqlSCD, tPostgresqlSCDELT, tPostgresqlValidRows

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

MariaDB 10.x support (MariaDB JDBC driver upgraded to 2.5.3)

Components concerned in Standard Jobs:

  • tCreateTable
  • tELTMysqlMap
  • tMysqlBulkExec, tMysqlConnection, tMysqlInput, tMysqlOutput, tMysqlOutputBulkExec, tMysqlRow, tMysqlSCD, tMysqlSCDELT, tMysqlSP, tMysqlCDC
  • tJDBCClose, tJDBCColumnList, tJDBCCommit, tJDBCConnection, tJDBCInput, tJDBCOutput, tJDBCRollback, tJDBCRow, tJDBCSCDELT, tJDBCSP, tJDBCTableList

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Salesforce version updated to v47

Salesforce v47 is now supported in Talend components.

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Default Salesforce endpoint updated

The default Salesforce endpoint updated as: https://login.salesforce.com/services/Soap/u/47.0 .

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Netsuite endpoint updated

Netsuite endpoint updated as: https://webservices.netsuite.com/services/NetSuitePort_2019_2 (API version 2019.2 required).

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Talend Administration Center

Feature Description

Product

Monthly update support Apart from the patches that Talend delivers to fix issues in the Studio, you can now get monthly update patches which contain cumulative patches delivered throughout the month.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Second level cache support You can now enable second level cache in Talend Administration Center to optimize the GUI performance.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

MSSQL official driver support In addition to the jTDS driver, MSSQL official driver is now supported for Azure SQL and SQL server databases.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

POST operation support to call MetaServlet It is now supported to use POST operation to call MetaServlet for additional security.

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform