November 2025 Summaries

In the blog post, the author explores the idea that significant engineering breakthroughs are often the result of numerous small, incremental improvements rather than a single revolutionary change. Using the example of the Valkey team, which scaled their system to handle a billion requests per second, the author highlights how these achievements are typically built on continuous refinements across the system rather than major overhauls. The text emphasizes that real innovation often involves removing inefficiencies and enhancing reliability, which can lead to compound progress and capability over time. The narrative suggests that while breakthroughs may appear sudden to outsiders, they are usually the culmination of persistent, unnoticed efforts, and it encourages engineers to appreciate the incremental work that leads to such transformative results.

Valkey 9.0 introduces an advanced feature called atomic slot migration, which significantly improves the process of cache cluster rebalancing by addressing the inefficiencies of the previous model. Previously, cache clusters faced issues during resizing due to the cumbersome method of moving keys individually, resulting in numerous redirects and increased latency. The new model, inspired by replication principles, employs a three-phase process: Snapshot, Streaming, and Finalization, which allows for seamless and efficient migration of slots without disrupting live traffic. This approach reduces the need for multiple client redirects and avoids unstable states, making the rebalancing process more reliable and less resource-intensive. By ensuring that changes are implemented in the background and ownership is atomically switched, Valkey 9.0 enhances the stability and performance of cache systems, making it possible to scale clusters without taking them offline, thereby offering a more reliable and efficient caching solution for Site Reliability Engineers (SREs).

Momento has developed a versatile platform centered on Valkey, facilitating hyperscale infrastructure for major clients like Coinbase and Snap by providing efficient, serverless caching and a variety of components tailored to enterprise needs. The platform's core, Valkey, can be flexibly integrated across any cloud environment, with Momento offering managed services that simplify operations through features like multi-region fleet management. Momento's innovations include the two-tier architecture for Redis and the hyperscale gateway router, Momento Accelerator (MAX), which optimizes performance with features like connection pooling and response caching. MAX integrates with various data services, enhancing scalability and efficiency, particularly through its caching solutions for services like S3 and DynamoDB. Moving forward, Momento is focused on streamlining deployment options and deepening integrations to support fast, efficient infrastructure at scale, alongside open-sourcing additional tools.

Valkey 9.0 introduces the concept of numbered databases, which significantly enhances the architecture of distributed caching systems by allowing logical separation of keys without the need for key prefixing. This feature, reminiscent of Redis's early design, permits data within the same key name to exist separately across different databases, thus enabling efficient multi-tenancy, instant data switching for use cases like e-commerce pricing changes, and parallel test environments without data collision. Valkey's approach eliminates the overhead of data migration and network transfer, offering a seamless way to move data between databases through simple pointer changes. This development simplifies multi-tenant applications, enhances the safety of A/B testing and CI environments, and reduces the risks associated with rollouts and migrations. Future enhancements may include named databases, per-database memory limits, and rate limiting, which will further bolster resource isolation and developer experience.

In episode 7 of the Cache It podcast, host Khawaja Shams engages Kyle Davis, the Senior Developer Advocate and open-source leader of Valkey, in a discussion about the new features in Valkey 9.0 beyond its widely acclaimed performance improvements. The conversation highlights how thoughtful design and community collaboration have driven architectural enhancements and expanded opportunities for developers creating high-performance systems. The episode emphasizes the rapid innovation within the Valkey community and the significant impact of small design details on major breakthroughs. Additionally, the discussion touches on the complexities of running Valkey at scale and how Momento simplifies operational challenges, allowing developers to focus on building efficient applications without infrastructure management concerns.