Introducing the Fivetran async provider in Airflow
Blog post from Fivetran
Fivetran has introduced an async provider for Airflow, developed in collaboration with Astronomer, allowing data engineers to run Fivetran data syncs more efficiently in Airflow 2.2+. The new provider utilizes deferrable operators and sensors, enabling asynchronous execution of tasks without consuming worker slots, thus improving the overall efficiency of Airflow deployments. This allows for I/O bound operations like data syncing to be performed without blocking other tasks or DAGs. The Fivetran async provider can be added to any Airflow 2.2+ environment with pip install airflow-provider-fivetran-async, and provides examples on how to use it in DAGs.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Data Pipeline | 1 | 475 | 100 | 40 | -27% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.