Home / Companies / Dragonfly / Blog / Post Details
Content Deep Dive

SSD Data Tiering Is Generally Available

Blog post from Dragonfly

Post Details
Company
Date Published
Author
Vlad Oleshko
Word Count
1,353
Language
English
Hacker News Points
-
Summary

Dragonfly SSD Data Tiering, now generally available, extends Dragonfly's in-memory data store capabilities by utilizing local NVMe SSDs to manage datasets larger than the available DRAM without requiring resharding or code changes. This feature maintains hot data in RAM for sub-millisecond latency while offloading warm and cold data to SSDs, ensuring keys and metadata remain in memory for efficient operations. Unlike Redis and Valkey, Dragonfly provides a Redis-compatible, source-available store with transparent SSD tiering, enhancing scalability and cost-efficiency without API changes. Its architecture mitigates the latency typical of disk I/O through a fiber-based execution model, non-blocking I/O with Linux io_uring, and a three-state data model that efficiently manages hot, cold, and cooled data states. Meesho, an Indian e-commerce platform, experienced significant performance improvements and cost savings using Dragonfly's tiering system compared to previous configurations. The tiering solution, optimized for larger String values, offers a seamless setup and is currently in beta for Dragonfly Cloud, promising scalable vertical growth without extensive infrastructure changes.