How Castform + Neon Beats Frontier Models on Price and Efficiency
Blog post from Neon
Castform and Neon describe a workflow for reinforcement-learning post-training of small open-source models to perform agentic search over company data, claiming that a 4B model trained this way matched GPT-5.6 Sol’s retrieval accuracy at roughly one-hundredth the cost. The approach responds to a shift from one-shot embedding-based RAG systems toward multi-step agentic retrieval, where frontier-model search loops can add substantial latency and expense. Castform generates synthetic questions and ground-truth answers from documents stored in Neon Postgres, trains models to use Lakebase Search’s text, vector, and hybrid retrieval tools, and evaluates them through rewards for finding correct sources, citing them, and answering accurately. The platform also provides training-run observability to inspect reward progress and diagnose issues such as faulty tools or reward hacking. Neon’s autoscaling database infrastructure is presented as useful for the bursty workloads created by many parallel search rollouts, while its branching and time-travel capabilities could support isolated, resettable environments for training agents that modify data as well as retrieve it.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Observability | 3 | 625 | 152 | 84 | -84% |
| Vector Search | 2 | 525 | 92 | 52 | -74% |
| AI Model Fine-tuning | 1 | 103 | 37 | 26 | -89% |
| LLM | 1 | 1,189 | 251 | 109 | -83% |
| RAG | 1 | 364 | 51 | 33 | -69% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.