Workers AI gets a speed boost, batch workload support, more LoRAs, new models, and a refreshed dashboard
Blog post from Cloudflare
The Cloudflare team has been working on improving the quality and usability of their Workers AI platform, a distributed inference platform that makes inference accessible to everyone. They have introduced several new features, including speculative decoding, which speeds up inference times by 2-4x, an asynchronous batch API for large workloads, and expanded LoRA support for more customized responses. The team has also updated pricing and added a new dashboard to improve the usability of the platform. Additionally, they have released new models, including four new ones, with improved performance and capabilities compared to their existing models. These updates aim to make Workers AI faster, more reliable, and more customizable while reducing costs.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Model Fine-tuning | 13 | 697 | 168 | 71 | +1% |
| LLM | 6 | 4,226 | 639 | 179 | -13% |
| RAG | 3 | 1,623 | 226 | 80 | +8% |
| Vector Search | 3 | 2,017 | 344 | 116 | +7% |
| Observability | 1 | 2,122 | 444 | 131 | +14% |
| Real-time | 1 | 6,887 | 1,132 | 212 | +49% |
| Serverless | 1 | 1,599 | 300 | 96 | +114% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.