Deterministic Simulation Testing in Diskless Apache Kafka

Aiven conducted extensive deterministic simulation testing on their temporary Apache Kafka fork, Inkless, designed to implement the Diskless Topics feature as outlined in KIP-1150. Using Antithesis, a tool that facilitates testing without requiring code modifications, Aiven subjected the system to approximately 2,200 logical hours of chaos testing. This rigorous testing approach, which simulates a variety of disk, network, and machine failures, did not reveal any issues with Inkless, although it did uncover a potential bug in the original Apache Kafka related to idempotent producers. The testing process highlighted the robustness of both Apache Kafka and Inkless, emphasizing the importance of continuous testing in software development to ensure reliability and uncover hidden bugs. The article also highlights the potential benefits of Diskless Topics, such as reduced total cost of ownership and enhanced scalability, while emphasizing the need for ongoing testing and development.