From 37 Million Monthly Executions: How Enterprise Teams Structure Kestra at Scale

Leroy Merlin transitioned from Airflow to Kestra for orchestrating their workflow executions, achieving significant improvements in performance and scalability. Their previous system was prone to slow execution and risked entire platform failures due to single task issues. The new Kestra architecture comprises three layers designed for scaling execution, isolating teams, and controlling execution locations. This architecture allows teams to operate independently through constructs like namespaces and tenants, providing isolation and user management tailored to organizational needs. Kestra's design enables tasks to be routed based on specific requirements such as data residency and GPU routing, using worker groups that can be scaled independently. This multi-layered approach not only supports extensive workflow executions but also addresses compliance and geographical constraints without the need for significant infrastructure rebuilding. The platform's open-source nature and ease of deployment make it a versatile choice for enterprises with complex orchestration needs.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.