Company
Date Published
Author
The ClickHouse Team
Word count
1481
Language
English
Hacker News points
None

Summary

Pump, likened to the "Costco of cloud" by Forbes, aggregates cloud usage from its customers to secure cost-effective deals from providers like AWS, and has developed Pump View, a cost visibility hub, to enhance transparency in cloud billing. This platform addresses the limitations of AWS Cost Explorer by offering detailed insights into expenses by region, usage type, or custom tags, powered by ClickHouse to handle the massive scale of data involved. The architecture, initially considered for Postgres, leverages ClickHouse for its ability to decouple reads from writes and handle bulk data ingestion, dealing with challenges such as semi-sparse records, ingestion volume, atomic updates, and interval queries. Pump uses a hybrid system where ClickHouse manages large-scale data processing, while Postgres ensures transactional consistency. Upcoming enhancements include integrating Azure as a new data provider and migrating more functionalities into ClickHouse to further optimize performance and scalability.