Company
Date Published
Author
Sandy Ryza
Word count
212
Language
English
Hacker News points
None

Summary

In this recent episode of The Data Stack Show, Sandy Ryza, Lead Engineer at Dagster Labs, shares insights on data cleaning, data engineering processes, and the need for improved tools. He introduces Dagster, an orchestrator that focuses on assets like tables, datasets, and machine learning models, contrasting it with traditional workflow systems. Dagster's integration with dbt is also discussed, as well as the changing dynamics in data roles, the impact of modern tooling, and potential for increased creativity in the field. The conversation highlights the evolving landscape of data orchestration and the importance of innovative tools like Dagster.