Company
Date Published
Author
Khawaja Shams
Word count
832
Language
English
Hacker News points
None

Summary

Momento, an early-stage startup focused on high-performance caching, has successfully optimized its open-core Pelikan caching engine for Google's new Arm-based Tau T2A VMs, achieving significant improvements in queries per second (qps) and cost efficiency. Initially expecting a complex and costly transition, the team found the adaptation process surprisingly straightforward, resulting in a 25% increase in performance goals and the ability to handle over one million queries per second at their 2ms p999 Service Level Objective (SLO). The T2A VMs offer advantages such as cheaper DRAM costs and increased core availability, which allow for larger in-memory working sets and higher throughput. Through head-to-head benchmarking and tuning, Momento realized improvements across both Arm and x86 VMs, proving the investment to be beneficial even at their current scale. The company emphasizes a flexible approach to adopting new processor technologies, encouraging businesses to evaluate cost and performance benefits without committing fully, and highlights their partnership with Google Cloud to enhance the price-to-performance ratio for their customers.