TypeSafe AI scales Jev to trillions of tokens in three days on Modal
Blog post from Modal
TypeSafe AI’s manifesto emphasizes building production-focused AI rather than pursuing generalized artificial intelligence, exemplified by Jev, a “System One Model” designed for rapid, structured decision-making. Unlike autoregressive large language models that generate text sequentially, Jev accepts state and questions as inputs and returns typed choices, probabilities, and confidence scores in parallel, making it suited to applications such as customer-support routing, large-scale automation, browser use, and generative interfaces. TypeSafe developed Jev with a custom architecture, parallel sampling, and a training approach called Reinforcement Learning for Calibrated Decisions. Following its Thursday launch, Jev rapidly gained demand, reaching 15.1% of OpenRouter requests for 1,000–10,000-token contexts within a week and processing more than one trillion tokens in three days. Modal provided the serverless training and inference infrastructure needed to support this bursty, high-concurrency workload with low latency, flexible autoscaling, and control over networking and routing without requiring TypeSafe to operate its own infrastructure.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Jev | 15 | 1,284 | 96 | 54 | -40% |
| LLM | 5 | 6,578 | 1,243 | 236 | +9% |
| Reinforcement learning | 1 | 162 | 88 | 37 | -7% |
| Serverless | 1 | 1,384 | 325 | 108 | +12% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.