Distant run configuration (Talend > Run/Debug) - 6.4

Talend Big Data Platform Studio User Guide

EnrichVersion
6.4
EnrichProdName
Talend Big Data Platform
task
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

Talend Studio allows you to deploy and execute your Jobs on a remote JobServer when you work on either a local project or a remote one.

You can also use the CommandLine to transfer your Jobs from your Talend Studio to a remote JobServer for Job execution. To use the CommandLine, make sure you have logged on to a remote project via a remote connection.

To remotely execute your Jobs, you need to configure the remote JobServer details in the Studio preferences. You can also configure the CommandLine you will use.

To open the preference page for distant run settings, do the following:

  1. From the menu bar, click Window > Preferences to open the [Preferences] dialog box.

  2. Expand the Talend and the Run/Debug nodes in succession and then click Remote.

To allow monitoring the JVM resource usage during Job execution on a remote JobServer, do the following:

  1. Select the Enable remote monitoring check box.

  2. In Remote JMX port field, enter a listening port number that is free in your system.

To define a specific Unix OS user allowed to start the Job execution on a remote JobServer, enter the user name in the Run as (Set up user for Unix) field. If left blank, any of the existing Operating System users can start the Job execution.

Tip

By default, the user name must start with a lower-case letter from a to z, followed by a combination of lower-case letters (a to z) and numbers (from 0 to 9). To allow using characters other than those letters and numbers, you need to modify the regular expression ^[a-z][-a-z0-9]*\$ in the value of the org.talend.remote.jobserver.server.TalendJobServer.RUN_AS_USER_VALIDATION_REGEXP parameter in the file {Job_Server_Installation_Folder}\agent\conf\TalendJobServer.properties. For example:

  • To define a user name pattern that should include a dot, like firstname.lastname, modify the regular expression to ^[a-z][-a-z0-9]*.[a-z][-a-z0-9]*\$.

  • To allow using one or more underscores (_) in the user name, modify the regular expression to ^[a-z][-a-z_0-9]*\$.

If the network condition is bad, enter an appropriate value in the Send job data package size field to ensure that the Job packages received on the JobServer are complete. By default, the maximum package size is 1048576 bytes (1 MB).

To add a remote Job server:

  1. In the Remote Jobs Servers area, click the [+] button to add a new line in the table.

  2. Fill in all the fields for the JobServer: Name, Host name (or IP address), Standard port, Username, Password, and File transfer Port. The Username and Password fields are not required if no users are configured in the configuration file conf/users.csv of the JobServer. For more information about Job execution server configuration, see the Talend Installation Guide.

    If you use the CommandLine to transfer your Jobs to the remote JobServer, make sure the JobServer name is identical to the execution server label configured in Talend Administration Center. For more information, see the Talend Administration Center User Guide.

To add a remote CommandLine server:

  1. Select the Enable commandline server (Deprecated) check box if you want to use a remote commandline.

  2. Click the plus button to add a new line in the table.

  3. Fill in the fields as configured for the commandline in Talend Administration Center: Name, Host name (or IP address), and Port. For more information, see Talend Administration Center User Guide.

Click Apply and OK to validate the changes.

For more information about how to execute a Job on a remote server, see How to run a Job remotely.