Company
Date Published
Author
Julia Wrzosińska
Word count
948
Language
English
Hacker News points
None

Summary

Apache Airflow 2.2.0, an open-source workflow orchestration platform, introduces significant updates and features aimed at enhancing its scheduling and task management capabilities. Released as the second major upgrade since Airflow 2.0, the new version includes AIP-39, which offers custom timetables for more flexible scheduling, and AIP-40, which introduces deferrable tasks to optimize resource usage by allowing tasks to pause until specific conditions are met. Additional features such as the @task.docker decorator enable functions to run within Docker containers, easing dependency management, while the Airflow standalone CLI command supports local development by running all components without Docker. Other improvements include DAG parameter validation, connection testing, and enhanced UI features for monitoring DAG runs. With 30 new features, 84 improvements, and 85 bug fixes, Airflow 2.2.0 aims to streamline data workflow orchestration, thanks largely to contributions from the Astronomer team.