Cosmos 1.14: Battle-Tested Watcher Mode
Blog post from Astronomer
Cosmos 1.14 has been released, offering significant enhancements for orchestrating dbt with Apache Airflow, particularly focusing on the Watcher execution mode and comprehensive documentation updates for easier adoption and scaling. The Watcher mode, which has gained traction since its experimental phase, allows for up to 80% reductions in Dag runtime by running a single dbt process per Dag run and utilizing Airflow sensor tasks to monitor model status in real time. This release introduces improved reliability, smarter resource routing, and enhanced visibility for dbt tests, aligning test visibility with model visibility and mapping test outcomes to Airflow task states. The update also includes better debugging capabilities, optimized performance for large Dags, and new features such as task-level memory tracking and organized Dag structures. Cosmos now supports dbt-loom for orchestrating across multiple dbt projects, offering end-to-end visibility. The revamped documentation focuses on practical guidance and common support topics, and Cosmos 1.14 integrates seamlessly with Astro for enhanced observability.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Observability | 3 | 4,496 | 812 | 176 | +40% |
| Kubernetes | 2 | 2,306 | 381 | 103 | +25% |
| AI Coding Assistant | 1 | 1,480 | 382 | 153 | +18% |
| Real-time | 1 | 6,296 | 1,346 | 246 | -2% |