Home / Companies / WarpStream / Blog / Post Details
Content Deep Dive

Middleware saves 85% by replacing Apache Kafka with WarpStream to power AI observability platform

Blog post from WarpStream

Post Details
Company
Date Published
Author
Richard Artoul
Word Count
530
Company Posts That Month
2
Language
English
Hacker News Points
-
Post removed?
No
Summary

Middleware is a cloud observability company that uses AI to help customers identify, understand, and fix issues across their infrastructure. They rely on scalable streaming infrastructure to ingest and process tens of TiBs of telemetry every day. Initially, they used Apache Kafka as a scalable queue between event intake and downstream storage systems, but faced scalability issues with customer workloads being unpredictable and requiring frequent partition rebalancing. To mitigate this, they over-provisioned broker VMs, which drove up cloud infrastructure costs significantly. They also ran their critical infrastructure in three availability zones to ensure reliability, resulting in high inter-zone networking fees. Middleware's data ingestion and storage team then adopted Warpstream, a cost-effective alternative that saved them more than 85% compared to their previous setup, allowing them to focus on developing features for customers instead of managing scaling issues.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Observability 3 1,226 277 96 -11%
Data Pipeline 1 359 139 62 -35%
Kubernetes 1 1,775 194 84 +6%
Real-time 1 2,551 676 196 -6%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.