Company
Date Published
Author
Sanjana Kaundinya
Word count
2189
Language
English
Hacker News points
None

Summary

The introduction of Automatic Observer Promotion in Confluent Platform 6.1 allows for a fast, automatic, and no-data-loss option for maintaining topic availability in the event of a failure in multi-datacenter stretch clusters. This feature is part of Multi-Region Clusters built directly into Confluent, which enables running a single Apache Kafka cluster across multiple datacenters with synchronous replication. Observers are effectively asynchronous replicas that replicate partitions from the leader but can never participate in the ISR or become a partition leader unless manually promoted through unclean leader election. Automatic Observer Promotion automates this process by promoting caught-up observers to the ISR list when a replica fails, restoring availability and allowing producers to once again produce data. This feature eliminates the need for manual intervention, reduces operational burden, and minimizes the risk of data loss and partition unavailability due to failover. It provides an RPO of zero while maintaining a low RTO, making it an essential tool for modern businesses that require mission-critical data protection.