Company
Date Published
Author
Nick Schrock
Word count
2450
Language
English
Hacker News points
None

Summary

Dagster has released version 0.10.0, codenamed "The Edge of Glory," which focuses on operational maturity, reliability, and the expansion of production-grade use cases. The release includes a new reconciliation-based scheduler that provides exactly-once, fault-tolerant scheduling of pipeline runs, as well as sensors that can be used to trigger pipeline runs based on updates to data assets produced or modified by executions of other pipelines. The system also features improved Kubernetes deployment options, I/O management, and a more flexible programming model. Additionally, the release includes new monitoring tools and a more user-friendly interface, making it easier for users to manage their Dagster deployments and pipelines.