Creating, running or resuming an execution plan - 6.3

Talend Administration Center User Guide

EnrichVersion
6.3
EnrichProdName
Talend Big Data
Talend Big Data Platform
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend Real-Time Big Data Platform
task
Administration and Monitoring
Deployment
EnrichPlatform
Talend Administration Center

To create a task execution plan, you need first to make sure that you have created the executions tasks from the Job Conductor page before adding a plan to the plan list and then group tasks under this plan combining the parallel and the sequential execution approaches. For more information on how to create execution tasks, see Adding a Normal execution task.

Add a task execution plan

  1. From the toolbar on the Execution Plan page, click Add Plan to open the plan creation panel to the right.

  2. In the Label field, enter a name to the task execution plan you want to create and then, if required, provide any useful information regarding the plan in the Description field.

    In the Timeout (s) field, type in, if necessary, how long to wait, in seconds, before the plan and its related tasks are killed by the server.

    In the Rollback field, select, if necessary, the task that will be executed if the plan is killed due to a timeout. For example, you can set a task that will warn the administrator (by email) that the plan has been killed, or that will perform the same action as the last task of the plan that could not be executed.

    Select the Pause triggers on error check box to pause in order to pause the trigger if an error occurs during the execution of a task.

  3. Click Save to validate the configuration or Cancel to cancel the creation of the task execution plan.

    The newly created plan is listed in the Execution Plan list.

Group tasks under the plan based on OnOK, OnError or After conditions

  1. In the Execution Plan list, select the plan to which you want to add tasks.

  2. Click Root: please configure this node in the right panel.

    The Edit planned task panel opens.

  3. To define multiple tasks for parallel execution at the root node, select the Use parallel execution check box.

    The configuration options for parallel execution appear.

  4. Click the Add Task button repeatedly to add as many task selection lists as needed, and select the desired tasks from the lists.

    Note that the same task cannot be added several times in the same node for parallel execution.

  5. Select the number of tasks for parallel execution from the Simultaneous exec. list, MAX chosen here to run all the selected tasks in parallel.

    Note

    • MAX means all the selected tasks will be executed simultaneously.

    • If N tasks are defined for parallel execution, the list also offers the options of 1~N. This means, you can choose 1 to run one task at a time, x (an integer between 1~N) to run x tasks at a time, or N to run all the tasks at a time, thus achieving flexible resource allocation for better performance.

    • A task defined for parallel execution cannot have the sub-nodes such as OnOk, OnError or After.

  6. After the root node has been configured, click Root > (Simultaneous exec.: MAX) to add child nodes: OnOk, OnError and After.

    To do so, click the buttons in the Planned task tree view panel.

    Buttons

    To...

    Add OnOk

    add a child task that will be launched if the parent task finalizes without error.

    Add OnError

    add a child task that will be launched if the parent task finalizes with error.

    Add After

    add a child task that will be launched after the parent task finalizes, regardless of its error status.

    Note

    OnOk and OnError can coexist as child nodes but neither of them can exist with After as child nodes.

  7. Click Add OnOk to add an OnOk node first.

    The task selection panel appears on the right.

  8. Select a task from the Task list and click Save.

  9. Click OnOk > Task: "Third_Task" and then the Add OnError button to add a child node.

    Select a task from the Task list and click Save.

  10. Click Root > (Simultaneous exec.: MAX) and then the Add OnError button to add an OnError child node for the root. Then select a task for this node.

    Add an After child node for this OnError child node as instructed above. Then select a task for this node.

Insert a task in an existing execution plan (optional)

You may want to insert a task before/after an existing task in your execution plan once its structure has been defined. To do so:

  1. Select the execution plan, then select the task before/after which you want to add a task.

  2. Right-click the task and select insert after/before > Add OnOk/Add OnError/Add After according to the action you want to perform.

  3. Select a task from the list and save your changes. The new task is displayed before/after the task you have previously selected.

Run the execution plan manually

This procedure explains how to run an execution plan manually. For more information on how to schedule it with triggers, see Scheduling an execution plan.

  1. On the Execution Plan page, select the execution plan.

  2. Click Run on the toolbar to execute the tasks according to the order and conditions set in the hierarchical view.

    Note

    You can add triggers to any plan to schedule its execution based on time or event, using time triggers or file triggers respectively. For further information, see Scheduling an execution plan.

    Upon completion of the execution, the preceding icons at respective nodes light up if their tasks have been launched. Meanwhile, the status of the executed tasks will appear in the square brackets on the right.

    The table below explains these icons:

    Icon

    Description

    The OnOk node's task has been launched. The status of execution is given in the square brackets on the right.

    The OnError node's task has been launched. The status of execution is given in the square brackets on the right.

    The After node's task has been launched. The status of execution is given in the square brackets on the right.

    Once the plan has been executed, you can also visualize its execution details (logs, history, advanced information) by clicking the corresponding icons in the Actions column of the Execution Plan page. To display the execution details of a specific task, select it in the central panel, right-click and select Display last execution details. For more information, see Monitoring task executions in the Monitoring node.

Restart a plan from a specific task or node

To ease error recovery, you may want to resume the execution of your plan from a specific task or node. For example, if one task of your plan fails because of a database connection issue and causes the plan to stop, you have the possibility to resume the execution of the plan from this specific task once the issue has been fixed, and thus to skip the previous tasks from the plan that were successfully executed.

  1. On the Execution Plan page, select the execution plan, then select the task/node from which you want to restart the plan.

  2. Right-click on the task/node and select Run execution plan from this node in the list.

    The execution of the plan is resumed from the selected task/node.