How To Use Streaming Joins with Apache Flink
Streaming data brings with it some changes in how to perform joins. In this video, David Anderson and Dan Weston talk about how and when to use temporal joins to combine your data.
Systems | Development | Analytics | API | Testing
Modern Software Development For Today's Systems & Applications
November 2023
A Deep Dive Into Sending With librdkafka
In a previous blog post (How To Survive an Apache Kafka® Outage) I outlined the effects on applications during partial or total Kafka cluster outages and proposed some architectural strategies to handle these types of service interruptions. The applications most heavily impacted by this type of outage are external interfaces that receive data, do not control request flow, and possibly perform some form of business transaction with the outside world before producing to Kafka.
Continuous Integration and Delivery (CI/CD) | Microservices 101
Continuous Integration (CI) is the process of automatically building and testing your code on every source control commit. Continuous Delivery (CD) takes this further and automatically deploys the code to production on every commit. Used together these techniques allow code to be built, tested, and deployed automatically through a robust CI/CD pipeline. CHAPTERS.
Top 7 Free Apache Kafka Tutorials and Courses for Beginners in 2023
Stepping into the world of Apache Kafka® can feel a bit daunting at first. I know this firsthand—while I have a background in real-time messaging systems, shifting into Kafka’s terminology and concepts seemed dense and complex. There’s a wealth of information out there, and it’s sometimes difficult to find the best (and, ideally, free) resources.
Introduction to Consumer Group IDs | Apache Kafka Explained
Lucia Cerchie explains what an Apache Kafka® Consumer Group ID is, and what role it plays in work sharing and rebalancing.
Polyglot Architecture | Microservices 101
Polyglot Architecture is a feature of microservices that allows each microservice to be built using a different technology stack. This approach provides developers the freedom to select the best tools for the job and allows them to be more creative with their solutions. However, like with any powerful tool, it can have negative consequences if it isn't used properly. CHAPTERS.
Handle Millions of IoT Devices Connected to Kafka via MQTT
From vehicle communication to predictive maintenance, real-time ingestion, analysis, and control has become an increasingly important characteristic of the machines we use in everyday life.
Build Streaming Apps Quickly with Flink SQL Workspaces
At this year’s Current, we introduced the public preview of our serverless Apache Flink® service, making it easier than ever to take advantage of stream processing without the complexities of infrastructure management. This first iteration of the service offers the Flink SQL API, which adheres to the ANSI standard and enables any user familiar with SQL to use Flink.
Branch by Abstraction | Microservices 101
The Branch by Abstraction Pattern is a method of trunk-based development. Rather than modifying the code in a separate branch, and merging the results when finished, the idea is to make modifications in the main branch. An abstraction layer is used to ""branch"" the code along an old and new path. This approach has some key advantages, especially when decomposing a monolith.
Introduction to Apache Kafka Clusters | Apache Kafka Explained
Lucia Cerchie explains what an Apache Kafka® cluster is, and why it's unique. Learn how Kafka supports speed, scalability, and durability through its cluster structure.