Baseten delivers open-source inference for You.com
Blog post from Baseten
You.com developed its Answer API to provide synthesized, fact-checked, and cited responses from live web data, addressing the limitations of LLMs that rely on static training information. Processing tens of millions of daily queries, the company partnered with Baseten to run open-source and fine-tuned models across dedicated multi-region infrastructure for tasks including entity recognition, embeddings, query expansion, reranking, intent prediction, and answer generation. Baseten serves models such as GLM-5.2 and Kimi K3, enabling You.com to combine web retrieval with lower-cost open-weight inference rather than relying entirely on proprietary frontier APIs. The production deployment reportedly achieved about a 60% latency improvement and 50% cost reduction while maintaining accuracy comparable to proprietary models, including a 93.48% Simple QA accuracy rate, 2.67-second median latency, and $5 cost per 1,000 calls for the Answer API.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 3 | 5,068 | 1,020 | 229 | -34% |
| Vector Search | 3 | 2,358 | 371 | 127 | +5% |
| Real-time | 1 | 4,432 | 1,050 | 222 | -31% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.