Systems | Development | Analytics | API | Testing

If you replicate data between two distinct Kafka clusters, you already know the payloads can match while the offsets might not. This post is about how K2K 2.0 now also keeps consumer committed offsets in sync between the source and the target so consumer groups can fail over in a Disaster Recovery situation, avoiding large re-reading of data or row skips. This offers the community more choice for DR than just MirrorMaker2 and Confluent solutions have until now.

Summary Kafka has become the backbone of the real-time enterprise. The streams it carries are not only time, but business critical: a fraud event isn't processed, a sales order not fulfilled, a trade not settled. Yet we heard a recurring theme from Kafka teams: their business is running critical streaming applications without proper Kafka resiliency.

Most multi-entity businesses do not choose their accounting systems. They inherit them. A new acquisition brings Xero. The legacy entity has been on Dynamics for eight years. The Czech subsidiary runs on ABRA Flexi and nobody is going near it. Your US portco uses QuickBooks, your UK one uses Sage Intacct, and the newest deal came with a NetSuite instance that the previous owner had half-implemented. You are not looking at a technology problem. You are looking at the reality of how groups grow.

Automated data integration enables AI and analytics based on mission-critical operational data stored in IBM Z.

Interoperability means the optionality to adapt to rapidly changing future demands.