Fixed cadence to seconds: making ClickHouse Cloud autoscaling more reactive
Blog post from ClickHouse
ClickHouse Cloud has enhanced its autoscaling mechanism to provide more immediate resource management by integrating a reactive system alongside its existing periodic recommendation service. Originally, the autoscaling system relied on a fixed schedule to assess and adjust resource allocations, which sometimes resulted in suboptimal performance during unexpected workload spikes. To address this, ClickHouse Cloud implemented a fast-path solution using controller-runtime, a library often associated with Kubernetes, to react to real-time signals such as out-of-memory events. By leveraging ClickHouse for real-time analytics, the system can now quickly determine which services need scaling adjustments, ensuring faster response times and optimizing resource usage without creating bespoke message systems. The use of controller-runtime allows for efficient deduplication, backoff, and concurrency management, thus enabling a more responsive autoscaling process that remains robust and scalable. The new approach enhances ClickHouse Cloud's ability to adjust resources dynamically, aligning provisioning more closely with current workloads and improving the overall user experience.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Kubernetes | 15 | 634 | 79 | 44 | -75% |
| Real-time | 5 | 1,106 | 270 | 109 | -81% |
| Data Pipeline | 1 | 69 | 36 | 22 | -87% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.