What is the Transactional Outbox Pattern? | Designing Event-Driven Microservices

What is the Transactional Outbox Pattern? | Designing Event-Driven Microservices

► LEARN MORE: https://cnfl.io/microservices-101-module-1

The transactional outbox pattern leverages database transactions to update a microservice's state and an outbox table. Events in the outbox will be sent to an external messaging platform such as Apache Kafka.

Check out the Microservices 101 course on Confluent Developer for more details: https://cnfl.io/microservices-101-module-1

This technique is used to overcome the dual-write problem which occurs when you have to write data to two separate systems such as a database and Apache Kafka. The database transactions can be used to ensure atomic writes between the two tables. From there, a separate process can consume the outbox and update the external system as required.

RELATED RESOURCES
► Eliminating the Double Write Problem in Apache Kafka Using the Outbox Pattern: https://cnfl.io/3UhVbVC
► Incorporating Event Storage: https://cnfl.io/492wmS0
► Microservices: An Introduction https://cnfl.io/3ZMt3up
► Event-Driven Microservices Architecture: https://cnfl.io/48FSYbj
► Migrate from Monoliths to Event-Driven Microservices: https://cnfl.io/3tsqlhu
► Get Started on Confluent Developer: https://cnfl.io/48FnKRB

CHAPTERS

00:00 - Intro

00:23 - What is the dual-write problem?

00:51 - What is the transactional outbox pattern?

01:33 - How can we emit events to Apache Kafka?

01:53 - What tools can be used to process an outbox?

02:49 - What delivery guarantees does the outbox pattern provide?

03:34 - What are the problems with the outbox pattern?

04:40 - Closing

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#microservices #apachekafka #kafka #confluent