Executing Job tasks on a Remote Engine or a cluster - Cloud

Talend Remote Engine User Guide for Linux

Version
Cloud
Language
English (United States)
EnrichDitaval
linux
Product
Talend Cloud
Module
Talend Remote Engine
Content
Design and Development
Installation and Upgrade

By scheduling its run on a Remote Engine or cluster, your Job task will be executed in an on-premises secure runtime.

By default, you can run 3 different or identical tasks in parallel on a single Remote Engine. For further information about the related configuration, see Running tasks in parallel on a single Remote Engine.

Warning:
  • Current Remote Engine sub folders tree should be reserved for internal use.
    .
    ├── activemq-data
    ├── bin
    ├── data
    ├── deploy
    ├── esbrepo
    ├── etc
    ├── instances
    ├── lib
    ├── scripts
    ├── system
    └── TalendJobServersFiles
  • Job generated (permanent) files can be stored in any new directory outside of <RemoteEngineInstallationDirectory>.
  • Temporary files should be managed with the tCreateTemporaryFile component.

Procedure

  1. Open the Management page.
  2. Select the environment from the Environment drop-down list at the top of the page.
  3. Click Tasks in the correct workspace.
  4. Select the task to run on the Remote Engine or cluster from the list.
    You can use the filters on the left-hand side of the page to limit the results.

    Example

  5. On the task details page, click next to Execution.

    Example

  6. In the Edit task wizard, select the Remote Engine or cluster on which you want to deploy the task from the Engine drop-down list.
  7. Optional: Select a run profile.
    You can choose a previously created run profile for the selected Remote Engine or cluster to set the JVM parameters for the task execution.
    This feature is supported from Remote Engine 2.9.1 onwards.
  8. Set the log level.

    Select the lowest log level to be taken into account.

    This feature is supported from Remote Engine 2.8.3 onwards.

    For example, if the log level is set to Warning, only logs flagged as Warning and Error will be displayed on the Task run log page.
  9. Optional: Select the Allow parallel run of this task option so that the task can be run in parallel when using a Remote Engine or a Remote Engine cluster.

    If you are using a Remote Engine to run identical tasks simultaneously, your Remote Engine must be v2.12.0 onwards.

    By default, you can run 3 different or identical tasks in parallel on a single Remote Engine. For further information about the related configuration, see Running tasks in parallel on a single Remote Engine.

    Before you disable this option, stop the task or wait for the end of the run. Otherwise, the parallel run is still allowed.

  10. Select the execution frequency from the Trigger type drop-down list.
  11. Optional: If you have scheduled the execution on a single engine, you have the option to run your Job as another user by entering their username in the Run as impersonated user field.
    For more information about user impersonation, see the Configuring user impersonation for Talend Remote Engine.
  12. Click Go live.