Using tFlowMeter and tFlowMeterCatcher for error handling - 7.3

Talend Open Studio User Guide

Version
7.3
Language
English
Product
Talend Open Studio for Big Data
Talend Open Studio for Data Integration
Talend Open Studio for Data Quality
Talend Open Studio for ESB
Module
Talend Studio
Content
Design and Development
Last publication date
2023-10-11
Available in...

Open Studio for Big Data

Open Studio for Data Integration

Open Studio for ESB

This section explains how to design error handling using tFlowMeter and tFlowMeterCatcher.

Based on a defined schema, tFlowMeterCatcher catches the processing volumetric from tFlowMeter and passes them on to the output component.

Sample Job

Design

In this example, the Job reads from a file, makes some changes and stores the output data in a user defined variable using the tJava component.

tFlowMeter is used to capture the inner join and reject records.

tFlowMeterCatcher is used to catch the records processed at both links. Then, it is used to check if all the records read are being processed and that no data is lost.

Using tWarn, it is captured as a message.

This Job ensures that there is no data leakage and that all the records that are read from the source file are either processed successfully or rejected.