Apache Kafka's native cluster mirroring makes cross-cluster replication a broker built-in

Data liberation: Apache Kafka's native cluster mirroring

Apache Kafka's native cluster mirroring makes cross-cluster replication a broker built-in

Apache Kafka's KIP-1279 embeds cross-cluster replication directly into the broker, eliminating external tools like MirrorMaker 2. A destination broker fetches committed records using the standard fetch protocol and appends them byte-for-byte, preserving offsets, compression, and consumer group state. The article details the architecture, mirror partition state machine, and consistency guarantees, then walks through disaster recovery and cluster migration scenarios with a video demo.

A destination broker fetches committed records from a source cluster using the same fetch protocol that followers already use, and appends them to local partition logs byte for byte.

More from this day

2026-09-24