Enhancements of Spark Job designer - 6.4

Talend Real-time Big Data Platform Release Notes

EnrichVersion
6.4
EnrichProdName
Talend Real-Time Big Data Platform
task
Installation and Upgrade
EnrichPlatform
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend ESB
Talend Identity Management
Talend Installer
Talend JobServer
Talend Log Server
Talend Project Audit
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio
  1. Spark 2.1 is now fully supported

  2. More components are available in Spark Batch and Spark Streaming Jobs regarding the following technologies or domains:

    • Google Cloud Platform: Cloud storage, BigQuery, Dataproc distribution and Pub/Sub.

    • Matching components: tMatchIndex and MatchIndexPredict.

    • Natural language processing components: tNLPPreprocessing, tCompareColumns, tNLPModel tCompareColumns and tNLPPredict.

    • Data Mapper component in Spark Streaming Jobs: tHMapRecord.

  3. Enhancements of existing components:

    • Some Data Mapper components and tDataPrepRun.

    • Support for Hive partitioning has been added to tHiveOutput.

    • Fully support for Kafka 0.10. on Kerberos.