Restartability with Talend Studio and Talend Administration Center
Overview
The ability to restart a Job from a point where it failed is called restartability. Whether you are programming in Talend or using any other language, checkpointing is a useful technique to ensure that your Jobs can be restarted and recover from a previous error.
Restartability
Restartability in Talend can be accomplished using both Talend Studio and Talend Administration Center. In Talend Studio you need the OnSubjobOk and OnSubjobError trigger links, and in Talend Administration Center you need to create tasks in the Job scheduler or the execution plan.
- Record the point of failure
- Resume from the point of failure without re-running successfully executed code
- Execute custom recovery code
- Perform a normal execution of previously non-executed code
You can set checkpoints on one or more OnSubjobOk or OnSubjobError trigger links used to connect components in your Job design. In case of failure during execution, this allows you to resume the execution of your Job from the last checkpoint before the error. Therefore, checkpoints within Job designs can be defined as reference points that can precede or follow a failure point during Job execution.
Restartability example
Procedure
Results
The first image below shows the files at the time of the Job failure, and the second image shows the files after restartability.