Home / Companies / AssemblyAI / Blog / Post Details
Content Deep Dive

Why small LLMs win on short transcripts and lose at meeting length

Blog post from AssemblyAI

Post Details
Company
Date Published
Author
-
Word Count
2,889
Company Posts That Month
15
Language
English
Hacker News Points
-
Post removed?
No
Summary

Voice Standard Bench indicates that small and low-cost open language models can approach frontier-model quality on voice transcripts under roughly two minutes, where latency often matters more than price, but their performance declines substantially on longer calls and meetings. Qwen3.5 4B Fast, hosted by AssemblyAI, is presented as the fastest option for short rewrite and dictation-cleanup tasks, although it has weaker correction and extraction quality and lacks structured output and tool-calling support. Other open models, including gemma-4-31b, GLM-5.3 Flash, and Nemotron 3 Nano, offer different tradeoffs in short-form quality, speed, and price, but generally trail larger models on 15- to 60-minute transcripts. The benchmark attributes this decline less to context-window limits than to difficulty retaining decisions, owners, and details across long conversations. It recommends routing requests by transcript length and task, using fast small models for brief latency-sensitive work, stronger proprietary models such as GPT-6 Luna for medium and long calls, and provider-diverse fallbacks for reliability, while emphasizing that organizations should test models against their own transcripts, prompts, and domain requirements.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 23 4,083 814 190 -32%
GPT-6 Astra 1 265 61 35 -57%
GPT-6.1 Sol 1 196 35 17 +1682%
Voice AI 1 1,833 162 38 -46%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.