Content Deep Dive
Announcing Dagster 0.7.0: Waiting To Exhale
Blog post from Dagster
Post Details
Company
Date Published
Author
Alex Noonan
Word Count
1,148
Language
English
Hacker News Points
-
Summary
Elementl has released version 0.7.0 of Dagster, codenamed "Waiting To Exhale", which improves the experience for large, production-scale pipelines deployable to Kubernetes. This release provides support for pipelines with hundreds or thousands of nodes, scalable monitoring tools, and other features such as revamped Dagit, Kubernetes and Celery support, backfill and partitioning support, and integration with Pandas dataframes schema and validation. The new features aim to address operational requirements for production-grade deployments, including navigation improvements, a live-updating visualization of execution plans, and easier scheduling utilities.