Home / Companies / Astronomer / Blog / Post Details
Content Deep Dive

Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%

Blog post from Astronomer

Post Details
Company
Date Published
Author
Matthew Keep
Word Count
845
Company Posts That Month
10
Language
English
Hacker News Points
-
Post removed?
No
Summary

ASAPP, an AI leader in the contact center industry, has successfully reduced workflow runtimes by 85% using Apache Airflow® and custom Apache Spark® solutions. The company's Data Ops and MLOps ecosystem is built to support continuous innovation, demanding deep analytics along with frequent retraining and fine-tuning of ML models. ASAPP leverages Airflow for data engineering, DataOps, and ML & LLM model training and evaluation. By integrating Spark for massive scaling, the company has significantly improved its ASR workflow runtimes from 43 hours to under 5 hours. Key learnings from ASAPP's experience with Airflow include strong orchestration foundation, integrated Spark support, and adaptability for LLM workflows.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 9 3,362 423 155 -16%
AI Model Fine-tuning 2 570 142 71 -38%
Real-time 2 3,579 860 226 -21%
Data Pipeline 1 486 185 70 -35%
Kubernetes 1 1,635 181 71 +11%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.