The Great Reset: How AI Is Forcing Data Teams Back to Zero

In a discussion between Joe Reis and Michael Driscoll, the focus shifts from Joe's earlier predictions of intelligence-driven organizations to the current reality of "The Great Reset" in data engineering, prompted by AI's transformative impact. This reset challenges the foundations of the Modern Data Stack era, pushing data teams to re-evaluate their approach as AI reshapes traditional workflows and toolchains consolidate. The conversation highlights the role of hidden "dark matter data," such as Excel sheets and shadow pipelines, which carry significant influence over AI systems. Despite the proliferation of AI-generated solutions, human craftsmanship remains crucial for defining clear and reliable data models. With the rise of autonomous agentic systems, the nature of data team roles is changing, emphasizing intent over execution. Joe expresses optimism about the future, encouraging teams to actively engage with these changes to help shape the next decade in data practices.