How To Manage Stateful Streams with Apache Flink and Java

How To Manage Stateful Streams with Apache Flink and Java

Oct 18, 2023

Managing state efficiently in a distributed streaming pipeline can be difficult. Thankfully, Apache Flink® has you covered. In this video, Wade Waldron will demonstrate how to use Flink's Keyed State feature to manage the state in a distributed cluster.

Take the "Building Apache Flink® Applications in Java" course now: https://cnfl.io/3rOyuwy

Check out the previous videos in this series:
► Consume Apache Kafka® messages using Apache Flink® and Java: https://youtu.be/JfqoVuVDYUE
► Produce Apache Kafka® messages using Apache Flink® and Java: https://youtu.be/bf6ZkcA68e8

ADDITIONAL RESOURCES
► Check out the "Flink 101" course for more information: https://cnfl.io/40754q8

CHAPTERS

00:00 - Intro

01:06 - Data Classes

02:00 - The Kafka Source

02:13 - The Kafka Sink

02:56 - Flink State Descriptors

03:49 - Retrieving Flink State

04:18 - Updating Flink State

05:16 - Building the Stream

07:53 - Compiling and Running

08:02 - Verifying it Works

08:42 - Next Steps

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#apachekafka #apacheflink #kafka #flink #confluent