August 2023 Summaries

This blog post discusses implementing a caching layer in web applications using the Fiber web framework and Dragonfly as the cache store. It covers the Cache-Aside pattern, creating a cache middleware, connecting to Dragonfly, and various aspects of cache management. The advantages of using Dragonfly as a cache store are also highlighted, including memory efficiency, high throughput, and its LFRU eviction policy for higher hit ratios.

Dragonfly claims to be the most performant in-memory data store on earth, boasting an impressive 4 million ops/sec on an AWS EC2 c6gn.16xlarge instance and fully leveraging CPU and memory resources. However, it is crucial to understand any technology's limits, including BigKeys issues. A BigKey refers to a key that has a large-sized value attached to it, which can impact the performance of the in-memory data store and subsequently your applications. In this blog post, we explored the infamous BigKey issue and established best practices for working with them in Dragonfly. By exploring both the strengths and constraints, we hope to provide a comprehensive understanding of working with BigKeys in Dragonfly as well as how it compares with Redis.

Feast is an open-source feature store that streamlines the management and serving of machine learning (ML) features. It offers a sophisticated interface for storing, discovering, and accessing features, which are essential measurable properties or characteristics of data used in ML modeling. Feast operates on a distributed architecture and supports both offline and online storage paradigms. One key advantage of Feast is its ability to serve features at low latency, ensuring quick access to necessary features for efficient and timely predictions or inferences. This is particularly important for real-time applications that require instant decisions or personalized recommendations. In-memory data stores like Dragonfly play a crucial role in achieving this by storing data directly in memory, eliminating the need for disk I/O operations and resulting in near-instantaneous response times. Dragonfly is an advanced in-memory data store that distinguishes itself with novel algorithms, data structures, and multi-threaded architecture. It offers exceptional API compatibility, making it a drop-in replacement for Redis as an online feature store for Feast. With its impressive blend of compatibility, efficiency, and comprehensive features, Dragonfly unlocks new dimensions of performance and scalability in Feast. Integrating Dragonfly as an online store in Feast is straightforward and doesn't require any changes to the core configuration. By simply directing Feast to use Dragonfly, users can benefit from its low-latency feature serving capabilities and hardware efficiency, which reduces infrastructure costs and complexity.