Enhancements of Spark Job designer - 6.1

Talend Big Data Release Notes

EnrichVersion
6.1
EnrichProdName
Talend Big Data
task
Installation and Upgrade
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Installer
Talend JobServer
Talend Log Server
Talend Project Audit
Talend Runtime
Talend Studio
  1. Spark 1.4 is fully supported.

  2. More components are available , such as:

    • New ElasticSearch components to read data from ElasticSearch and provide ElasticSearch connection configuration for reuse.

    • Native connectors to Hive with the support of ORC file format.

    • New processing component: tTopBy.

    • The tLoop component is added to allow users to create iterations on a task execution in a Spark Batch Job.

  3. Support for Continuous Integration has been added to Spark Batch Jobs.