Dagster and the Decade of Data Engineering

The decade of data engineering has arrived, and it's about taming the chaos of managing production data assets. Data engineering is a discipline that unites roles such as ML engineers, analytics engineers, and data platform engineers, creating an interconnected graph of data assets. The current state of data engineering is characterized by siloed tools and point solutions, leading to organization-wide chaos. A unified control plane, like Dagster's asset graph, can bring order to this chaos, providing benefits such as productivity, context, and consolidation. This new layer empowers teams to develop and operate their data assets confidently and efficiently, making it a critical infrastructure challenge of the decade.