Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%
Blog post from Astronomer
ASAPP, an AI leader in the contact center industry, has successfully reduced workflow runtimes by 85% using Apache Airflow® and custom Apache Spark® solutions. The company's Data Ops and MLOps ecosystem is built to support continuous innovation, demanding deep analytics along with frequent retraining and fine-tuning of ML models. ASAPP leverages Airflow for data engineering, DataOps, and ML & LLM model training and evaluation. By integrating Spark for massive scaling, the company has significantly improved its ASR workflow runtimes from 43 hours to under 5 hours. Key learnings from ASAPP's experience with Airflow include strong orchestration foundation, integrated Spark support, and adaptability for LLM workflows.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 9 | 3,362 | 423 | 155 | -16% |
| AI Model Fine-tuning | 2 | 570 | 142 | 71 | -38% |
| Real-time | 2 | 3,579 | 860 | 226 | -21% |
| Data Pipeline | 1 | 486 | 185 | 70 | -35% |
| Kubernetes | 1 | 1,635 | 181 | 71 | +11% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.