How Leroy Merlin France Enabled Data Mesh at Scale with Kestra

Leroy Merlin France (LMFR) embarked on a transformative journey to migrate from a traditional on-premises data platform to a scalable Data Mesh Architecture using Kestra, addressing several bottlenecks they faced with their existing infrastructure. Initially, they turned to Apache Airflow but encountered issues such as complexity in task creation, reliability, security concerns, and high costs, making it unsuitable for their needs. Kestra, with its declarative data orchestration capabilities, provided a more streamlined, reliable, and cost-effective solution that simplified workflow management and enhanced data processing efficiency. This shift enabled LMFR to implement a data mesh architecture, allowing different data products to take ownership of their respective data models and promoting a self-serve data platform structure. As a result, Kestra facilitated a significant increase in data production, with LMFR achieving over a 900% growth in data tasks executed monthly, emphasizing the tool's scalability and flexibility.