Scheduling pipeline tasks - Cloud

Talend Cloud Management Console for Pipelines User Guide
Version
Cloud
Language
English
Product
Talend Cloud
Module
Talend Pipeline Designer
Content
Administration and Monitoring > Managing projects
Administration and Monitoring > Managing users
Deployment > Deploying > Executing Tasks
Deployment > Scheduling > Scheduling Tasks

Define how frequently you want to run your pipeline task.

Note that schedule updates that are made within three minutes prior to the scheduled execution time immediately impact the execution. For this reason, avoid making schedule changes when an execution is about to be triggered.

Before you begin

If parallel execution is not allowed for the task, for an optimized design we recommend to leave at least a one minute margin between the end of the first execution and the beginning of the next.

About this task

You can define multiple time triggers for the same Pipeline task.

You can have 15 triggers including Once, Daily, Weekly, Monthly and Cron types for each task.

Triggers must be separated by at least five minutes.

Note: When you edit the schedule of a single-triggered task in the UI, this task is converted to multi-triggered. Once done, you need to use GET /executables/tasks/{taskId}/schedule endpoint to get task schedule details.

Procedure

  1. If you are editing your task after it has been created, go to its details page, then click the icon next to Trigger.
  2. In the Schedule step, click the Add trigger icon.
    To start the task manually without a trigger, go to the task details page and click Run now.
  3. Enter the name of the trigger.
    The name must contain only alphanumeric, -, # and _ characters. Spaces and other special characters are not allowed.
  4. Select the trigger type from the Trigger type drop-down list.
  5. In the Location (time zone) field, define the time zone for your executions.
  6. Enter the start date of the run.
  7. Define the frequency of the execution in days/weeks/months.
    For example, if you want to run your task every day, enter 1.
  8. To run the task at specific times during the day, select At specific time(s) from the Repeat drop-down list and enter the execution times below.
  9. Configure the execution times by typing in the time then clicking on it in the drop-down list.

    Example

    The task will run at 09:00, 12:00, and 16:00 every day.
  10. To run the task at intervals, select Specific intervals from the Repeat drop-down list.
    1. Set the interval time in minutes in the Repeat every field.
    2. Enter the start time for the execution in the Repeat from field.
    3. Enter the end of executions in the Repeat to field.
    The execution will happen every 10 minutes every day between 06:00 and 18:00.
  11. Click Save and close.

Results

A confirmation message is displayed at the top of the page. You are redirected to the task details page. The schedule you have defined appears under Trigger > Trigger type.

You can also view the schedule in the Tasks tab. Click the Triggers and plans icon.