Creating pipeline tasks - Cloud

Talend Cloud Management Console for Pipelines User Guide
Version
Cloud
Language
English (United States)
Product
Talend Cloud
Module
Talend Management Console
Content
Administration and Monitoring > Managing projects
Administration and Monitoring > Managing users
Deployment > Deploying > Executing Tasks
Deployment > Scheduling > Scheduling Tasks
Pipeline tasks are executable integration processes that contain a pipeline artifact published from Talend Cloud Pipeline Designer.

Before you begin

  • To create pipeline tasks, you must have Author permission on the workspace where the task is located.
  • To execute pipeline tasks on a Remote Engine Gen2, you must have Execute permission on the workspace.

About this task

You have the option of saving the task as a draft at every step of the creation process. If you save an incomplete task, its Run type will be Not defined.

Procedure

  1. Open the Management page.
  2. Select the environment from the Environment drop-down list at the top of the page.
  3. Click Add task.
  4. Select the Pipeline artifact type.
  5. Select the artifact you want to execute from the drop-down list.
    The details and description of the artifact appears.
  6. Select the version of the artifact to be used in the task.

    You can select Always use the latest available artifact version if you want your task to be updated automatically each time a new version of the artifact is published. You can also select a specific version and update it manually as needed.

    The details and description of the artifact are refreshed automatically.
  7. Select the workspace for the task.
  8. Give a name to the new task.
    By default, the task name is the name of the artifact from which it is created.
    Note: Tasks must have a unique name within a workspace.
  9. Optional: Add a tag to the task.
    1. Select an existing tag from the drop-down list.
    2. Create a new tag by typing in the name and clicking on it in the drop-down list.
  10. Click Continue.
  11. In the Go Live section, select the engine on which to run your task from the Runtime drop-down list.
    • Cloud Engine for Design
    • A pre-configured Remote Engine Gen2
  12. Select a Run Profile for the execution.
  13. Select the execution frequency from the Trigger type drop-down list.
    For instructions, see Scheduling pipeline tasks.
  14. Click Go live.

Results

Your task is ready to run on Talend Cloud Management Console.

Note: If you try to execute a task that is already running, the execution fails. Talend Cloud Management Console retries the execution every 4 minutes. If the deployment fails for the fifth time, you will get the error message Exceeded the limit of deployment attempts: another instance of the same task was running on the engine at same time. Try to run the task later.

Example