How Frank McSherry’s company achieves achieves sub-10ms latency at scale

Materialize, an operational data warehouse, achieves sub-second latency by streaming data from various sources in real time, allowing businesses to leverage data instantly. Initially, Materialize operated as a single binary limited to a single node, which restricted its database size and fault tolerance. In 2022, they transitioned to a cloud-based architecture to enhance scalability and availability without compromising speed and correctness. This transition involved adopting managed services such as Amazon EKS and Amazon S3, but they needed a robust metadata layer, leading them to evaluate several database options. They selected CockroachDB for its managed solution, which met their requirements for speed, correctness, and scalability, as well as provided a positive collaborative experience with Cockroach Labs.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.