Executing Job tasks on a Remote Engine or a cluster - Cloud

Talend Remote Engine User Guide for Linux

Version
Cloud
Language
English (United States)
Product
Talend Cloud
Module
Talend Remote Engine
Content
Design and Development
Installation and Upgrade

By scheduling its run on a Remote Engine or cluster, your Job task will be executed in an on-premises secure runtime.

Warning:
  • Current Remote Engine sub folders tree should be reserved for internal use.
    .
    ├── activemq-data
    ├── bin
    ├── data
    ├── deploy
    ├── esbrepo
    ├── etc
    ├── instances
    ├── lib
    ├── scripts
    ├── system
    └── TalendJobServersFiles
  • Job generated (permanent) files can be stored in any new directory outside of <RemoteEngineInstallationDirectory>.
  • Temporary files should be managed with the tCreateTemporaryFile component.

Procedure

  1. Go to Management.
  2. Select the correct environment from the top menu.
  3. Click Tasks in the correct workspace.

    Example

  4. Select the task to run on the Remote Engine or cluster from the list.
    You can use the filters on the left-hand side of the page to limit the results.

    Example

  5. On the task details page, click next to Execution.

    Example

  6. In the Edit task wizard, select the Remote Engine or cluster on which you want to deploy the task from the Runtime drop-down list.
  7. Optional: Select a run profile.
    You can choose a previously created run profile for the selected Remote Engine or cluster to set the JVM parameters for the task execution.
  8. Set the log level.

    Select the lowest log level to be taken into account.

    This feature is only available with engine versions 2.8.3 and above.

    Example

    If the log level is set to Warning, only logs flagged as Warning and Error will be displayed on the Task execution log page.
  9. Optional: If you have scheduled the execution on a single engine, you have the option to run your Job as another user by entering their username in the Run as impersonated user field.
    For more information about user impersonation, see the Configuring user impersonation for Talend Remote Engine.
  10. Optional: If you have chosen an engine cluster as the runtime, you can run the task on multiple engines at the same time by selecting the Allow parallel execution of this task option.
  11. You can also select the execution frequency from the Run type drop-down list.
  12. Click GO LIVE.