Home / Companies / Baseten / Blog / Post Details
Content Deep Dive

Baseten delivers open-source inference for You.com

Blog post from Baseten

Post Details
Company
Date Published
Author
Marylise Tauzia
Word Count
704
Company Posts That Month
10
Language
English
Hacker News Points
-
Post removed?
No
Summary

You.com developed its Answer API to provide synthesized, fact-checked, and cited responses from live web data, addressing the limitations of LLMs that rely on static training information. Processing tens of millions of daily queries, the company partnered with Baseten to run open-source and fine-tuned models across dedicated multi-region infrastructure for tasks including entity recognition, embeddings, query expansion, reranking, intent prediction, and answer generation. Baseten serves models such as GLM-5.2 and Kimi K3, enabling You.com to combine web retrieval with lower-cost open-weight inference rather than relying entirely on proprietary frontier APIs. The production deployment reportedly achieved about a 60% latency improvement and 50% cost reduction while maintaining accuracy comparable to proprietary models, including a 93.48% Simple QA accuracy rate, 2.67-second median latency, and $5 cost per 1,000 calls for the Answer API.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 3 5,068 1,020 229 -34%
Vector Search 3 2,358 371 127 +5%
Real-time 1 4,432 1,050 222 -31%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.