Home / Companies / AssemblyAI / Blog / Post Details
Content Deep Dive

AssemblyAI's Universal-3.5 Pro Realtime is the only model in Coval's Human Parity Zone

Blog post from AssemblyAI

Post Details
Company
Date Published
Author
Kelsey Foster
Word Count
1,699
Company Posts That Month
28
Language
English
Hacker News Points
-
Post removed?
No
Summary

AssemblyAI's Universal-3.5 Pro Realtime model has been recognized as the only model within Coval's Human Parity Zone, which signifies it matches or exceeds human performance in both accuracy and speed in speech-to-text tasks. Coval's independent, open-source benchmark evaluates models using a standardized methodology, scoring them on accuracy via word error rate (WER) and latency, the time before a model starts responding. The Universal-3.5 Pro Realtime model achieved a 3.40% WER and the fastest response time, outperforming 28 other models, including those from Google and OpenAI. This model's ability to match human transcription performance is attributed to its innovative Context Carryover feature, which enhances accuracy by intelligently applying conversation context, setting a new standard for voice agents in both transcription and responsiveness. Coval's benchmarks are valued for their transparency and reproducibility, using a mix of easy and complex audio samples to reflect real-world use cases, and are available for public verification, ensuring the integrity of the results.

Trends Found in this Post

No tracked trend matches for this post yet.

Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.