Home / Companies / Confluent / Blog / Post Details
Content Deep Dive

Kafka Streams’ Take on Watermarks and Triggers

Blog post from Confluent

Post Details
Company
Date Published
Author
Victoria Xia, John Roesler, Wade Waldron
Word Count
3,710
Language
English
Hacker News Points
-
Summary

The Kafka Streams data processing engine has introduced a new feature called `Suppress` that allows developers to fine-tune the timing of KTable updates, enabling more precise control over data processing pipelines. This feature is designed to support use cases where non-retractable side effects are required, such as sending emails or committing resources, and provides strong guarantees about when exactly it forwards KTable updates downstream. The `Suppress` operator can be used to rate-limit just one KTable output or callback, effectively controlling the flow of updates in specific parts of an application. It also allows for the final results of a windowed aggregation to be emitted, making it easier to build alerts and other non-retractable side effects.