Home / Companies / AssemblyAI / Blog / Post Details
Content Deep Dive

Universal-3.6 Pro Realtime: trained on real conversations, built for real voice agents

Blog post from AssemblyAI

Post Details
Company
Date Published
Author
-
Word Count
5,989
Company Posts That Month
25
Language
English
Hacker News Points
-
Post removed?
No
Summary

Universal-3.6 Pro Realtime is a streaming speech-to-text model designed for voice agents and call centers, where brief responses, noisy telephone audio, accents, background voices, and spoken entities such as phone numbers can affect downstream actions. Trained on tens of thousands of hours of real voice-agent conversations, it reportedly reduces short-response errors by 45%, language-confusion sessions by 74%, background-speech leakage by 29%, and normalized word error rates by 12% versus Universal-3.5 Pro on the company’s 12,460-scenario English benchmark, with larger gains in heavy noise. The release improves turn detection through training on incomplete speech and introduces entity-aware endpointing, which holds turns open for numbers, IDs, addresses, and similar information, reducing phone-number entity errors while increasing latency only in the slowest cases. An optional voice-focus feature uses filtered audio to suppress a nearby competing speaker, producing substantial gains in tests containing second talkers but modest accuracy costs when no competing speaker is present. The model also adds 14 languages, including Korean and Russian, expands multilingual training, and reports reduced code-switching errors; in the company’s competitive tests it ranks first among 21 systems for English voice-agent word and entity accuracy and code-switched language pairs, while placing third on average across broader multilingual read-speech benchmarks.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Real-time 38 4,852 1,086 241 +4%
Universal-3.6 Pro Realtime 9 17 4 1 -
Voice AI 7 3,416 307 52 +20%
LLM 2 6,033 1,166 244 +15%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.