Configuring Spark connection using the Job script API - 6.5

Configuring Spark connection using the Job script API

author
Talend Documentation Team
EnrichVersion
6.5
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Real-Time Big Data Platform
task
Design and Development > Designing Jobs > Job Frameworks > Spark Batch
Design and Development > Designing Jobs > Job Frameworks > Spark Streaming
EnrichPlatform
Talend Studio
In addition to the visual Spark configuration interface available when designing a Spark Job in the Studio, a Job script is another way to do this configuration.

Talend Studio enables you to create Jobs directly by writing their script. As a Job design, a Job script can be made of one or several components linked together. The properties of each component and connection require to be configured individually, in order to function properly.

This chapter provides specific information about configuring Spark connection for your Job using Job scripts.