How to work with a paused stream | Apache Flink in Action

How to work with a paused stream | Apache Flink in Action

Sep 24, 2024

Using Apache Flink® watermarks can create havoc when you have a stream that has significant delays between records. In this video we’ll talk about a possible solution to this situation using a batch close record, which will ensure that your data is up to date.

Try Flink without worrying about the setup or configuration in Confluent Cloud: https://cnfl.io/3MM8EAa

RELATED RESOURCES
► Event Time and Watermarks from Flink 101 Course - https://cnfl.io/3zrfw2z
► Watermark Alignment in Apache Flink - https://youtu.be/HxVcs9SNZEg
► Exactly Once Processing in Apache Flink - https://www.youtube.com/watch

CHAPTERS

00:00 - What are streams with no events?

01:05 - Sending a batch close record

01:34 - Close record in action

04:52 - Outro

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#apacheflink #flink #confluent