Introducing valkey-lab: Stop Guessing When Your Cache Hits Its Limit

Valkey-lab is a high-performance benchmarking tool designed to provide a more nuanced understanding of cache performance than traditional tools like valkey-benchmark, focusing on real-world workload conditions and latency behaviors. Unlike conventional benchmarks that offer a single throughput number, valkey-lab utilizes io_uring for efficient I/O, multi-threaded workers, and streams detailed latency data per second, enabling users to identify performance issues such as hot keys and tail spikes. By automating the saturation search process to determine the headroom number, it helps users find the maximum request rate a cache can handle before latency exceeds the Service Level Objective (SLO). Additionally, valkey-lab's output can be saved in Parquet format for detailed analysis and comparison, supporting regression testing and root cause analysis. Built on cachecannon, it requires a Linux environment with kernel 6.0+ and is built with Rust, offering insights vital for capacity planning and ensuring system reliability under production conditions.