Home / Companies / Astronomer / Blog / Post Details
Content Deep Dive

Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%

Blog post from Astronomer

Post Details
Company
Date Published
Author
Matthew Keep
Word Count
845
Company Posts That Month
10
Language
English
Hacker News Points
-
Post removed?
No
Summary

ASAPP, an AI leader in the contact center industry, has successfully reduced workflow runtimes by 85% using Apache Airflow® and custom Apache Spark® solutions. The company's Data Ops and MLOps ecosystem is built to support continuous innovation, demanding deep analytics along with frequent retraining and fine-tuning of ML models. ASAPP leverages Airflow for data engineering, DataOps, and ML & LLM model training and evaluation. By integrating Spark for massive scaling, the company has significantly improved its ASR workflow runtimes from 43 hours to under 5 hours. Key learnings from ASAPP's experience with Airflow include strong orchestration foundation, integrated Spark support, and adaptability for LLM workflows.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 9 2,876 370 130 -20%
AI Model Fine-tuning 2 547 127 59 -39%
Real-time 2 3,107 740 193 -25%
Data Pipeline 1 462 169 63 -36%
Kubernetes 1 1,530 167 62 +10%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.