Adding a new Hadoop connection context manually to the built Job

You can manually add a Hadoop environment to the Job, without the help of the Studio.

Before you begin

This Job must be using contextualized Hadoop connections. This means that your Job is using the Repository property type to reuse the Hadoop connection for which contexts have been defined.

You can search for further information about how to use metadata in a Job on Talend Help Center.

For further information about how to define contexts for a Hadoop connection in the Studio, see Contextualizing the Hadoop connection parameters.
The Job you need to deploy must have been properly built from the Studio and is unzipped.

You can search for further information about how to build Jobs to deploy and execute them on any server, independent of Talend Studio, on Talend Help Center.

In the contexts folder, duplicate the Dev.properties and rename it Prod.properties.
In the lib folder, duplicate the hadoop-conf-cdh5100_Dev.jar and rename it hadoop-conf-cdh5100_Prod.jar.
Open the hadoop-conf-cdh5100_Prod.jar and replace the configuration files with those from the production cluster.

You can then use the Prod context in the command to load the Prod configuration in the Job.

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!