Announcing AI Driven Data Engineering
Blog post from Dagster
AI coding agents are transforming the workflows of data engineers, and Dagster University has introduced a specialized course, AI-Driven Data Engineering, to address this shift. This eight-lesson course is designed to guide engineers in building a production-ready ELT pipeline using AI prompts, while imparting practical patterns for reliable AI-assisted development. The course is suitable for both newcomers to Dagster and those looking to optimize their use of the platform, as well as engineers interested in agentic coding workflows. It focuses on selecting appropriate AI tools, guiding AI agents toward best practices, and developing discernment in evaluating AI-generated outputs. To facilitate effective AI-driven development, Dagster has invested in tools like an opinionated CLI and maintained agent skills that ensure alignment with Dagster standards. The course aims to make Dagster's expertise more accessible, helping every data engineer become proficient in the platform, with the course being free and open to everyone.