Company
Date Published
Author
Katy Farmer
Word count
1413
Language
English
Hacker News points
None

Summary

Eventual consistency is a model used by many distributed systems, including InfluxDB Enterprise edition, which ensures high availability but requires maintaining data accuracy. Anti-entropy (AE) is a service that checks for inconsistencies in the system and aims to minimize data loss. AE works in conjunction with the Hinted Handoff queue (HHQ), which saves data during node outages, to maintain consistency. The HHQ has practical limits, such as storage size and time constraints, and can only address common scenarios. Starting from InfluxDB Enterprise 1.5, AE examines each node's shard distribution and copies missing shards automatically. With the introduction of InfluxDB Enterprise 1.6, AE can also review consistency across nodes and repair inconsistencies. The service relies on at least one copy of a shard being available to perform its heroism, and it cannot compare or repair hot shards.