Google-Scale Authorization: Getting to 1 Million QPS on SpiceDB Dedicated with CockroachDB

We successfully scaled SpiceDB Dedicated to 1 million requests per second with 100 billion relationships stored, while maintaining sub-problem cache hit ratios above 90% and average latency below 5.76ms for CheckPermission and 74.1ms for WriteRelationships. Our test setup used CockroachDB as the data storage backend, leveraging EKS to distribute pods across virtual machines and isolating workloads onto distinct compute pools. We identified areas for improvement in SpiceDB Dedicated, including connection balancing and pruning, quantization window smearing, and static-CPU management in Kubernetes nodes. The results demonstrate the performance capabilities of SpiceDB Dedicated and provide valuable insights into planning and executing large-scale load tests against CockroachDB.