Data Integration: new features - 6.5

Talend Big Data products Release Notes

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Open Studio for Big Data
Talend Real-Time Big Data Platform
task
Installation and Upgrade

Feature

Description

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Improved Cloud connection setup

The Studio now allows you to set up a Cloud connection by simply selecting the Cloud server without having to fill in the server URL manually.

Warning on imports from community product versions

As a precautionary measure, the Studio now displays a warning message when you import artifacts exported from a community product version to remind you of possible compatibility issues and security risks and allow you to choose whether to cancel or continue with the import. When migrating from a community version to a commercial version, consult Talend Support to temporarily disable the warning.

More options at remote connection failure

When failing to connect to the defined remote server, the Studio now displays a dialog box to allow you to:

  • retry the remote connection, or cancel the connection and check the connection details
  • modify the connection timeout time to allow more retries, without having to log in using a local connection and modifying the timeout time in the Studio preference settings
  • disable the dialog box until the next restart of the Studio

Creation of multiple connections at the same time

The Studio now allows you to create multiple connections in one go using a connection creation script.

Automatic JobServer information retrieval for load balancing

When working on a remote connection, the Studio now automatically retrieves the JobServer information and allows you to select a virtual server to execute a Job to achieve load balancing.

Db Connections metadata wizard enhancement

The Db Connections metadata wizard now supports specifying additional parameters and retrieving calculation view schemas for the SAP HANA database.

Enhanced Amazon S3 support

The tS3Connection component now supports connecting to Amazon S3 using a custom region endpoint.

Enhanced ELT support

  • The tELT***Map components now allow you to set the output table name and connection name to variables.

  • The tELTJDBC*** components now support aggregating Snowflake data.

Enhanced Generic JDBC support

The generic JDBC components tJDBC*** now support the latest Amazon Redshift JDBC Driver.

Enhanced JSON support

The tExtractJSONFields and tFileInputJSON components now allow you to specify the JSONPath API version.

Enhanced Marketo support

  • The endpoint for Marketo SOAP API has been updated to the latest API version.

  • A new column marketoGUID of String type has been added to the schema of tMarketoInput for the getLeadActivity and getLeadChanges operations.

Enhanced Microsoft CRM support

The tMicrosoftCrm*** components now support reading and writing data in Microsoft CRM 2016 on-premise database.

Enhanced NetSuite support

The tNetsuiteInput component now supports retrieving both body fields and sublist values of Netsuite records.

Enhanced SAP support

  • Talend Studio now ships with more SAP function modules to support extended SAP functionalities.

  • A new component tSAPADSOInput, which allows you to retrieve data of an active ADSO (Advanced Data Store Object) from an SAP BW system, has been added to Talend Studio.

  • A new component tSAPODPInput, which allows you to retrieve data from an SAP BW system via ODP (Operational Data Provisioning), has been added to Talend Studio.

  • The tSAPDSOInput component and the tSAPInfoCubeInput component now support retrieving data from an SAP BW system in batch mode via an FTP connection.

  • The tSAPTableInput component now allows you to specify the maximum length of data to be retrieved for the sstring and string type fields whose size are set to 0 in SAP data dictionary.

  • The SAP metadata wizard now supports retrieving the schemas of SAP Business Content Extractors and Advanced Data Store Objects.

  • Talend SAP RFC Server now supports connecting to a remote broker and exposing the broker’s service to JMX.

Enhanced SCD support

  • The tJDBCSCDELT component now supports tracking data changes in Vertica 7.1 and 9.0 tables.

  • The tJDBCSCDELT component now supports tracking Snowflake data changes using a sequence to generate the surrogate key.

Enhanced Snowflake support

The tSnowflake*** components now support handling data of VARIANT type.

Enhanced Vertica support

  • The tVertica*** components now support Vertica 9.0.

  • The tVerticaBulkExec and tVerticaOutputBulkExec components now support specifying more COPY parameters when loading data into Vertica 6.0 and later.

  • The tVerticaBulkExec component can now work as an output component and you can connect a tFileInputRaw component to it to load data into Vertica.

Other component enhancements

The tCreateTable component now supports creating Exasol, Redshift, and Vertica 7.1 database tables.

Talend Administration Center

Feature

Description

Talend Open Studio for Big Data

Talend Big Data

Talend Big Data Platform

Talend Real-Time Big Data Platform

Talend JobServer authentication compatibility

There can be only one authentication mode configured on Talend JobServer at a time.

It is highly recommended to use the authentication based on Talend Administration Center while using Talend Studio remote projects.

The authentication based on a .csv file is not supported anymore for remote projects. This authentication mode can still be used for Talend Studio local projects.

Generic Identity Provider plugin

Any Identity Provider can be used to access Talend Administration Center through single sing-on (SSO), if the authentication plugin jar file is uploaded during configuration. The jar files provided by Talend are located in the <TomcatPath>/webapps/ org.talend.administrator/idp/plugins directory.

PingFederate SSO

It is possible to configure PingFederate to enable secure outbound and inbound solutions for SSO to Talend Administration Center.

Auditor user type

The new Auditor user can be added to all projects. The Auditor can access the audit logs.

The Auditor has access to the following pages in Talend Administration Center:
  • Monitoring > Logging
  • Configuration > Logs
Audit logs

Audit logs are used to detect and analyze problems in how the application is used (for example, attempted attacks or malicious activities by authorized users). The audit logs send selected security events to Talend Log Server by http appender.

The audit logs can be viewed on the Kibana dashboard on the Logging page ofTalend Administration Center.