Skip to main content

Joining movie and director information using an Apache Spark Batch Job

This scenario demonstrates:
  1. How to create a Talend Job for Apache Spark Batch. See Creating the Spark Batch Job for details.

  2. How to drop and link the components to be used in a Spark Batch Job. See Dropping and linking Spark components for details.

  3. How to configure the input components using the related metadata from the Repository. See Configuring the input data for details.

  4. How to configure the transformation to join the input data. See Configuring the data transformation for details.

  5. How to write the transformed data to ADLS. See Writing the output to Azure ADLS Gen1 for details.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!