Processing Without Pause: Continuous Stream Processing and Apache Flink | Life Is But A Stream

Processing Without Pause: Continuous Stream Processing and Apache Flink | Life Is But A Stream

Feb 18, 2025

We’re diving even deeper into the fundamentals of data streaming to explore stream processing—what it is, the best tools and frameworks, and its real-world applications.

Our guests, Anna McDonald, Distinguished Technical Voice of the Customer at Confluent, and Abhishek Walia, Staff Customer Success Technical Architect at Confluent, break down what stream processing is, how it differs from batch processing, and why tools like Flink are game changers.

You’ll learn:

  • The key differences between stream and batch processing
  • How different frameworks like Flink, Kafka Streams, and ksqlDB approach stream processing
  • The role of POCs and observability in real-time data workflows
  • And more…

ABOUT THE GUESTS:
Anna McDonald is the Distinguished Technical Voice of the Customer at Confluent. She loves designing creative solutions to challenging problems. Her focus is on event-driven architectures, reactive systems, and Apache Kafka®.

Abhishek Walia is a Staff Customer Success Technical Architect at Confluent. He has years of experience implementing innovative, performance-driven, and highly scalable enterprise-level solutions for large organizations. Abhishek specializes in architecting, designing, developing, and delivering integration solutions across multiple platforms.

GUEST HIGHLIGHTS:
“Flink is more approachable because it blends approaches together and says, ‘If you need this, you still can use this.’ It's the most powerful at this point.” - Abhishek Walia

“If you're somebody who's ever gone from normal to eventing, at some point you probably would have gone, ‘When does [the data] stop?’ It doesn't stop.” - Anna McDonald

“ Start with a fully managed service. That's probably going to save a lot of cycles for you.” - Abhishek Walia

EPISODE TIMESTAMPS:

01:44 - Anna & Abhishek’s Journey in Data Streaming

14:35 -   Data Streaming 101: Stream Processing

38:56 -   The Playbook: Tools & Tactics for Stream Processing

49:00 -   Voices from the World of Data Streaming

50:00 - Meme of the Week

53:35 -    Quick Bytes

57:10 - Top 3 Takeaways

LINKS & RESOURCES:
► Connect with Joseph: @thedatagiant
► Joseph’s LinkedIn: linkedin.com/in/thedatagiant
► Anna’s LinkedIn: linkedin.com/in/jbfletch
► Abhishek’s LinkedIn: linkedin.com/in/abhishek-walia
► Introducing Derivative Event Sourcing: https://cnfl.io/4gPC8K4
► Designing Event-Driven Systems: https://cnfl.io/4gPCeRW
► Learn more at: https://cnfl.io/40rKeSD

OUR SPONSOR
Your data shouldn’t be a problem to manage. It should be your superpower. The Confluent Data Streaming Platform transforms organizations with trustworthy, real-time data that seamlessly spans your entire environment and powers innovation across every use case. Create smarter, deploy faster, and maximize efficiency with a true Data Streaming Platform from the pioneers in data streaming. Learn more at confluent.io.

#datastreaming #streamprocessing #apacheflink #flink #confluent