GCache: Caching Without the Chaos

Galileo faced performance issues due to fast shipping and feature prioritization, leading to slow endpoints and challenges with caching implementation. To address this, they developed GCache, a library that provides an opinionated wrapper around standard caching tools like Redis and cachetools, offering features such as built-in Prometheus metrics, gradual rollout capabilities, and a multi-layer read-through cache. GCache emphasizes cautious and structured caching by default, requiring explicit activation and allowing for targeted cache invalidation based on a consistent key structure. This approach minimizes risks associated with caching bugs and operational difficulties. The implementation of GCache in a high-traffic endpoint at Galileo resulted in significant latency and CPU usage improvements, allowing for rapid shipping and validation of caching changes without redeployment. The success of GCache at Galileo mirrors its previous implementation in Kotlin at DoorDash, addressing similar challenges across different languages and environments, and is now being used in production for various services at Galileo.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.