98% faster queries, 50% lower cloud costs: Verihubs’ journey from Postgres to ClickHouse

Verihubs, an AI company specializing in identity infrastructure for major Indonesian banks and fintechs, transitioned its data warehouse from a Postgres-based setup to a ClickHouse architecture to enhance its analytics capabilities. The previous system relied on daily batch data pulls from Postgres, which led to slow query processing and challenges in data accuracy and timeliness. By adopting ClickHouse and utilizing Kafka for real-time data streaming, Verihubs achieved up to 98% faster query speeds and a 50% reduction in cloud costs, transforming its dashboards into interactive OLAP experiences. This new setup allows real-time ingestion and post-processing, significantly improving data freshness and reliability, which is crucial for the company's large-scale operations involving around 50 million API calls monthly. The migration also taught Verihubs the importance of careful database design and the nuances of ClickHouse's performance profile, particularly regarding its MergeTree engines and the handling of updates and backfills. The shift to ClickHouse not only accelerated query performance but also optimized costs and improved user experience, enabling stakeholders to access up-to-date information more efficiently and aiding finance teams in reconciliation and invoicing.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.