Company
Date Published
Author
ClickPipes Team
Word count
939
Language
English
Hacker News points
None

Summary

ClickPipes is a solution designed to manage real-time data ingestion into ClickHouse Cloud, supporting various data sizes and topologies through object storage, message brokers, and databases. It has introduced new scaling options to enhance flexibility in configuring streaming workloads, allowing users to control both horizontal and vertical scaling by selecting the number of replicas and replica sizes. The system utilizes replicas that act as consumers of Kafka or Kinesis data sources, which can be scaled to match workload demands, enabling high-throughput, scalable ingestion with efficient load distribution. Users can configure these settings through a UI, OpenAPI, or Terraform, and monitor resource usage via enhanced monitoring tools to optimize the cost-performance ratio. Pricing now varies based on replica size and count, starting at $0.0125 per hour, with additional data ingestion costs, enabling users to better manage expenses according to their specific needs.