tKafkaCommit - 6.1

Talend Open Studio for Big Data Components Reference Guide

EnrichVersion
6.1
EnrichProdName
Talend Open Studio for Big Data
task
Data Governance
Data Quality and Preparation
Design and Development
EnrichPlatform
Talend Studio

Function

The tKafkaCommit component connects to a given tKafkaInput to perform a consumer offset commit. Note that the term 'commit' in this component means saving what messages are consumed by this tKafkaInput component at the moment of committing.

Purpose

tKafkaCommit saves the current state of the tKafkaInput to which it is connected.

tKafkaCommit properties

Component family

Internet/Kafka

 

Basic settings

Commit offsets from

Select the tKafkaInput component from which the consumed messages are committed.

Advanced settings

tStatCatcher Statistics

Select this check box to gather the processing metadata at the Job level as well as at each component level.

Usage

Although tKafkaCommit can be used as an end component in a Subjob flow or can be called independently as its own Subjob, it is typically used standalone to commit a batch of offsets in one go. If you need to commit offsets regularly, it is recommended to use the Auto-commit feature in tKafkaInput.

Related scenarios

No scenario is available for this component yet.