tKafkaCommit properties for Apache Spark Streaming

These properties are used to configure tKafkaCommit running in the Spark Streaming Job framework.

The Spark Streaming tKafkaCommit component belongs to the Messaging family.

This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.

Basic settings

Commit offsets from	Select the tKafkaInput component from which the consumed messages are committed.

Usage rule	To use tKafkaCommit, the Auto-commit offests check box in the Basic settings view of the tKafkaInput component must be cleared. This component is supported with Spark v2.0 and onwards in the Local Spark mode. It is typically used standalone to commit a batch of offset. This component, along with the Spark Streaming component Palette it belongs to, appears only when you are creating a Spark Streaming Job.

Usage rule

To use tKafkaCommit, the Auto-commit offests check box in the Basic settings view of the tKafkaInput component must be cleared.

This component is supported with Spark v2.0 and onwards in the Local Spark mode. It is typically used standalone to commit a batch of offset.

This component, along with the Spark Streaming component Palette it belongs to, appears only when you are creating a Spark Streaming Job.

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!