Performance Upgrades for Enterprise in Kestra 1.2
Blog post from Kestra
Kestra 1.2 introduces significant performance upgrades aimed at reducing execution latency and database contention, particularly under large workloads with parallel workflows. The release features a new parallel file loading strategy, which enables faster task startup by downloading namespace files concurrently using multiple CPU cores, significantly reducing startup times. Additionally, the update enhances concurrency performance by minimizing database locking through grouped execution message processing, resulting in a twofold improvement in scenarios with high concurrency, such as ForEach tasks. These optimizations contribute to a more scalable and predictable performance without requiring workflow changes, underscoring Kestra's commitment to efficient large-scale orchestration.