ストリーミング ClickPipes の柔軟なスケーリングと強化されたモニタリング
Blog post from ClickHouse
ClickHouse Cloud's ClickPipes has introduced new scaling options to enhance flexibility and efficiency in managing diverse data ingestion workloads, addressing customer requests for more adaptable configurations. The platform now supports both vertical and horizontal scaling for streaming ClickPipes, allowing users to adjust the number and size of replicas deployed, thereby optimizing for cost and performance. Each replica operates as a consumer for Kafka or Kinesis streaming data sources, enabling high-throughput and scalable data ingestion with fault tolerance and efficient load balancing. Enhanced resource monitoring displays CPU and memory usage, aiding in informed scaling decisions. The new default setting for replicas is Extra Small, with a flexible pricing model starting at $0.0125 per hour, reflecting the adjusted cost strategy aligned with replica size and number. This advancement allows customers to better manage data ingestion workloads, maintaining performance while controlling expenses.