Introducing Enhancements to Starburst Galaxy’s Autoscaler

Starburst Galaxy has introduced enhancements to its autoscaler, which now considers a range of new metrics such as CPU load, estimated runtime, queue length, and insights from completed queries to enable more proactive and cost-effective autoscaling. Previously reliant only on CPU utilization, the autoscaler now triggers scaling decisions more quickly, typically within two minutes, to address a broader range of workloads and improve resource efficiency. These improvements aim to reduce query execution times without increasing costs, as demonstrated by customer tests showing significant performance gains; for instance, query times decreased from 5.86 to 4.52 minutes for schema sf10000 and from 24.35 to 13.80 minutes for schema sf100000. The enhancements are designed to prevent the need for overcommitting compute resources and address constraints beyond CPU, ensuring faster query execution and eliminating manual resource adjustments. Users can experience these improvements by starting a free trial of Starburst Galaxy.