Creating pipeline tasks - Cloud

Talend Cloud Management Console for Pipelines User Guide

author
Talend Documentation Team
EnrichVersion
Cloud
EnrichProdName
Talend Cloud
task
Administration and Monitoring > Managing projects
Administration and Monitoring > Managing users
Deployment > Deploying > Executing Tasks
Deployment > Scheduling > Scheduling Tasks
EnrichPlatform
Talend Management Console
Pipeline tasks are executable integration processes that contain a pipeline artifact published from Talend Cloud Pipeline Designer.

Before you begin

  • To create pipeline tasks, you must have Author permission on the workspace where the task is located.
  • To execute pipeline tasks on a Remote Engine Gen2, you must have Execute permission on the workspace.

About this task

You have the option of saving the task as a draft at every step of the creation process. If you save an incomplete task, its Run type will be Not defined.

Procedure

  1. Go to Management.
  2. Click ADD TASK.
  3. Select the Pipeline artifact type.
  4. Select the artifact you want to execute from the drop-down list.
    The details and description of the artifact appears.
  5. Select the version of the artifact to be used in the task.

    You can select Always use the latest available artifact version if you want your task to be updated automatically each time a new version of the artifact is published. You can also select a specific version and update it manually as needed.

    The details and description of the artifact are refreshed automatically.
  6. Select the workspace for the task.
  7. Give a name to the new task.
    By default, the task name is the name of the artifact from which it is created.
    Note: Tasks must have a unique name within a workspace.
  8. Optional: Add a tag to the task.
    1. Select an existing tag from the drop-down list.
    2. Create a new tag by typing in the name and clicking on it in the drop-down list.

      Example

  9. Click CONTINUE.
  10. In the Go Live section, select the engine on which to run your task from the Runtime drop-down list.
    • Cloud Engine for Design
    • A pre-configured Remote Engine Gen2
  11. Select a Run Profile for the execution.
  12. Select the execution frequency from the Run Type drop-down list.
    For instructions, see Scheduling pipeline tasks.
  13. Click GO LIVE.

Results

Your task is ready to run on Talend Cloud Management Console.

Note: If you try to execute a task that is already running, the execution fails. Talend Cloud Management Console retries the execution every 4 minutes. If the deployment fails for the fifth time, you will get the error message Exceeded the limit of deployment attempts: another instance of the same task was running on the engine at same time. Try to run the task later.

Example