Using tFlowMeter and tFlowMeterCatcher for error handling - Cloud - 8.0

Talend Studio User Guide

Version
Cloud
8.0
Language
English
Product
Talend Big Data
Talend Big Data Platform
Talend Cloud
Talend Data Fabric
Talend Data Integration
Talend Data Management Platform
Talend Data Services Platform
Talend ESB
Talend MDM Platform
Talend Real-Time Big Data Platform
Module
Talend Studio
Content
Design and Development
Last publication date
2024-03-28
This section explains how to design error handling using tFlowMeter and tFlowMeterCatcher.

Based on a defined schema, tFlowMeterCatcher catches the processing volumetric from tFlowMeter and passes them on to the output component.

Sample Job

Sample Job in the design workspace.

Design

In this example, the Job reads from a file, makes some changes and stores the output data in a user defined variable using the tJava component.

tFlowMeter is used to capture the inner join and reject records.

tFlowMeterCatcher is used to catch the records processed at both links. Then, it is used to check if all the records read are being processed and that no data is lost.

Using tWarn, it is captured as a message.

This Job ensures that there is no data leakage and that all the records that are read from the source file are either processed successfully or rejected.