Scaling reinforcement learning at Applied Compute
Blog post from Modal
Applied Compute develops custom enterprise AI agents using reinforcement learning to create “Specific Intelligence,” in which models are trained on proprietary company data, evaluated through tailored reward functions, and continually improved from operational use. Founded by contributors to OpenAI’s Codex and o1 efforts, the company has built applications such as DoorDash’s menu-to-storefront onboarding system and Cognition’s software bug-detection agent. Its approach depends on tightly integrated rollout, evaluation, and inference systems, with Modal providing infrastructure for ephemeral, high-fidelity production-system simulations, parallel grading workloads, and GPU-optimized inference. Modal’s fast container startup, isolated sandboxes, caching, retries, and serverless scaling are presented as helping Applied Compute reduce training bottlenecks, maintain reliability at high concurrency, and run complex reinforcement-learning loops. Applied Compute argues that as frontier models become more widely available, companies will increasingly differentiate themselves by owning the post-training processes, evaluation frameworks, proprietary data pipelines, and continual learning systems that adapt AI to their individual operations.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Reinforcement learning | 2 | 99 | 49 | 28 | -9% |
| AI Agents | 1 | 5,657 | 1,451 | 270 | -3% |
| AI Model Fine-tuning | 1 | 667 | 209 | 74 | +41% |
| Harness engineering | 1 | 199 | 112 | 59 | +2% |
| LLM | 1 | 9,814 | 1,776 | 243 | +42% |
| Serverless | 1 | 1,846 | 630 | 102 | +131% |
| Vector Search | 1 | 2,438 | 477 | 143 | +23% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.