Hello, Assets: Unifies Orchestration, Catalogs, and Lineage
Blog post from Kestra
Kestra Assets revolutionizes data and infrastructure governance by integrating it directly into workflow orchestration, offering a seamless approach to tracking, cataloging, and lineage mapping across various resources. It treats tables, files, and cloud assets as first-class entities, linking them to specific workflows through declarative asset declarations that capture inputs and outputs. This system is technology-agnostic, supporting diverse tools and languages, thus ensuring consistent governance regardless of the underlying technology. By automatically generating lineage graphs and maintaining execution histories, Kestra Assets provides real-time visibility into data flows and infrastructure dependencies, reducing manual documentation and guesswork. This enhances collaboration across data, platform, and engineering teams by making assets discoverable and reusable, while also enabling impact analysis, clear resource ownership, and enforceable modeling conventions. The innovation lies in transforming orchestration from mere task execution to a comprehensive platform that understands and governs the entire data ecosystem, ensuring transparency, trust, and accountability in data operations.