How to Visualize Real-Time Data from Apache Kafka using Apache Flink SQL and Streamlit

How to Visualize Real-Time Data from Apache Kafka using Apache Flink SQL and Streamlit

Oct 31, 2024

Data visualization is cool, but have you tried setting up a chart of real-time data? In this video, Lucia Cerchie shows you how to create a live visualization of market data. She starts by producing data to a topic in Confluent Cloud from an Alpaca API websocket, then processes that data with Flink SQL, and finally uses a Streamlit component for a real-time visualization.

You can view the demo, as well as other real-time data demos, on this page: https://cnfl.io/4hFDQzl

RELATED RESOURCES
► Getting started with Kafka and Python: https://cnfl.io/3AkKxpq
► Alpaca API: https://alpaca.markets/
► Confluent Cloud: https://cnfl.io/40lfc0w
► Demo simulation: https://flink-st-kafka.streamlit.app/
► Read Lucia's blog on How to use Flink SQL, Streamlit, and Kafka: https://cnfl.io/3C5srIF

CHAPTERS

00:00 - Intro

00:14 - Step 1: Get set up in Confluent Cloud

02:40 - Step 2: Your Alpaca credentials

03:26 - Step 3: Get started running the app

03:38 - Step 4: Looking into the code

05:14 - Outro

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#streamlit #apacheflink #flink #flinksql #apachekafka #kafka #confluent