September 2025 Summaries

Kestra 1.0 introduces significant performance and scalability enhancements, primarily through optimizations in MySQL queries, worker thread scaling, and Kafka Streams, resulting in faster execution times, reduced latency, and increased throughput for both open-source and Enterprise deployments. The collaboration with Xiaomi led to notable improvements in MySQL query execution, drastically reducing time from 30 seconds to a few hundred milliseconds by replacing deprecated query methods. The default number of worker threads has been increased, improving throughput and reducing latency, particularly noticeable at higher execution rates. Additionally, enhancements to the Kafka backend now allow the system to better utilize available resources, doubling the maximum supported throughput to 4000 executions per minute. These upgrades underscore Kestra’s commitment to continually improving system performance and scalability, with further developments anticipated.

Kestra has introduced a Long-Term Support (LTS) release model with the launch of Kestra 1.0, marking a significant step toward providing predictable upgrade paths and long-term stability for production environments. Each LTS release will occur every six months and be supported for one year, with a maximum of two versions maintained concurrently. Weekly backports will ensure critical fixes and updates are applied consistently, with patch releases scheduled every Tuesday. This approach aims to balance stability with innovation, allowing for fast iteration in development environments while maintaining reliability in production settings. The latest LTS versions are clearly labeled in GitHub release notes, and users can easily track the most recent stable production release via a Docker image tag.

AI Agents in Kestra 1.0 introduce a new paradigm for workflow orchestration, shifting from static task lists to dynamic decision engines powered by Large Language Models (LLMs), memory, and tools. These agents autonomously determine actions and their order, allowing for adaptable and intelligent workflows that can reason, adapt, and make decisions on the fly. Unlike traditional workflows that require pre-defined sequences, AI Agents use system messages, prompts, memory, and a suite of tools to interact with external systems and maintain context across executions. They support multiple LLM providers and memory backends, offering flexibility and adaptability in creating declarative workflows. While AI Agents enhance dynamic orchestration, they are non-deterministic, making them unsuitable for mission-critical tasks requiring strict control and repeatability. Kestra offers a balanced approach by combining traditional task-based orchestration with AI Agents, maintaining workflows that are declarative, observable, and managed as code.

Kestra 1.0 introduces a range of innovative features aimed at enhancing orchestration and automation through AI-driven capabilities. This long-term support (LTS) release introduces AI Copilot and AI Agents, enabling users to generate and refine declarative flow code using natural language prompts and autonomous AI-driven tasks that can dynamically orchestrate workflows. The update also includes AI-powered search for navigating Kestra's documentation, a connection to AI IDEs via the Model Context Protocol (MCP), and dynamic defaults for flow inputs using Pebble expressions. Additionally, Kestra 1.0 offers a redesigned dependency view, a Playground feature for iterative workflow building, and flow-level SLAs for enforcing execution standards. Enterprise Edition users gain access to enhanced plugin versioning, a multi-panel editor for apps, and comprehensive unit testing capabilities. Deployment is simplified with new Helm Charts, and various plugin enhancements expand integration options with platforms like GitLab, Supabase, and Trivy. Overall, Kestra 1.0 positions itself as a robust platform for building and managing complex workflows with increased flexibility and automation.

Kestra is set to launch its highly anticipated version 1.0, marking a significant milestone in the field of orchestration by providing a stable, enterprise-ready, open-source platform tailored for the AI era. Built on principles of open-source transparency, Kestra combines community accessibility with enterprise-grade features, ensuring no lock-in and compatibility across different environments, including on-premises and cloud. The platform's declarative orchestration approach allows users to define workflows and automate processes seamlessly, enhancing portability, version control, and governance. Originating from a need for a more adaptable orchestration tool at Leroy Merlin France, Kestra has evolved through community contributions and now serves major companies like Apple and JPMorgan Chase, handling billions of workflows. Kestra's ecosystem boasts extensive plugin support, ensuring integration without compromising quality. With the upcoming 1.0 release, Kestra commits to long-term support and reliability, offering a foundational orchestration layer across data, infrastructure, and business operations.

Kestra's continuous performance improvements before reaching version 1.0 are highlighted by significant enhancements in scheduling and execution throughput, thanks to contributions from the Xiaomi engineering team. The engineering team focused on optimizing the scheduler, which initially took 20 minutes to start with 100,000 flows and triggers, but now takes only 8 seconds due to the implementation of a local cache for triggers. Additionally, changes to the JDBC queue's polling mechanism allow immediate re-polling when results are returned, enhancing processing capabilities and reducing execution latency under high load. Moreover, the Kestra executor's parallelization strategy evolved from running multiple parallel database queries to processing results from a single query in parallel, improving resource utilization and nearly doubling performance. These advancements, largely driven by Xiaomi's production-scale insights, demonstrate a commitment to enhancing Kestra's scalability and efficiency.

Kestra 1.0, set for release on September 9, 2025, promises to revolutionize the field of orchestration by offering a declarative approach that simplifies the creation and management of workflows, addressing issues like complexity and scalability that have plagued traditional orchestration methods. By allowing users to specify the desired outcomes rather than detailing procedural steps, Kestra provides a transparent, powerful, and efficient solution that is already trusted by major global enterprises such as Apple, Toyota, and JPMorgan Chase. With over 20,000 GitHub stars and widespread adoption across various industries, Kestra is an open-source orchestrator that integrates seamlessly with existing enterprise ecosystems, including platforms like Snowflake and Databricks, and is backed by tech leaders such as the founders of Datadog and Hugging Face. The platform's AI-powered capabilities and plugin architecture enable it to manage increasingly dynamic and intelligent workflows, making it a robust choice for the AI-driven future of orchestration.