Company
Date Published
Author
Owen Kephart
Word count
1887
Language
English
Hacker News points
None

Summary

The new release of Dagster, version 0.12.0, introduces several impactful features, including asset sensors that launch pipeline runs in response to asset updates, a community-contributed MLFlow integration, and a fully-fledged example repo demonstrating best practices for various Dagster features. The release also includes major experimental changes to core APIs, such as renames and unification of concepts like presets and partition sets. Additionally, Dagster now supports easy solid-level retries, allowing pipelines to automatically retry flaky steps, and direct invocation for testing, making it easier to test individual components of pipelines in isolation. These new features aim to improve the ergonomics and usability of Dagster, addressing pain points for many users.