Enhancements of Spark Job designer - 6.4

Talend Data Fabric Release Notes

Talend Data Fabric
Installation and Upgrade
Talend Activity Monitoring Console
Talend Administration Center
Talend Artifact Repository
Talend CommandLine
Talend Data Preparation
Talend Data Stewardship
Talend DQ Portal
Talend ESB
Talend Identity Management
Talend Installer
Talend JobServer
Talend Log Server
Talend MDM Server
Talend MDM Web UI
Talend Project Audit
Talend Repository Manager
Talend Runtime
Talend SAP RFC Server
Talend Studio
  1. Spark 2.1 is now fully supported

  2. More components are available in Spark Batch and Spark Streaming Jobs regarding the following technologies or domains:

    • Google Cloud Platform: Cloud storage, BigQuery, Dataproc distribution and Pub/Sub.

    • Matching components: tMatchIndex and MatchIndexPredict.

    • Natural language processing components: tNLPPreprocessing, tCompareColumns, tNLPModel tCompareColumns and tNLPPredict.

    • Data Mapper component in Spark Streaming Jobs: tHMapRecord.

  3. Enhancements of existing components:

    • Some Data Mapper components and tDataPrepRun.

    • Support for Hive partitioning has been added to tHiveOutput.

    • Fully support for Kafka 0.10. on Kerberos.