Agent Context Carryover: more accurate voice agent transcription on LiveKit

AssemblyAI’s Agent Context Carryover feature for Universal-3.5 Pro Realtime improves LiveKit voice-agent transcription by allowing the speech-to-text model to use the agent’s latest reply and prior user turns as context, reducing errors in short responses, emails, addresses, spoken numbers, and unfamiliar proper nouns. The accompanying tutorial explains how to start from LiveKit’s Python agent template, install the AssemblyAI plugin, replace the default speech-to-text provider, add credentials, and run the agent, with automatic assistant-context forwarding available in livekit-agents version 1.6.6 or later. A restaurant-ordering test involving multilingual menu items and a delivery address reportedly transcribed difficult names and details accurately without custom vocabulary or key-term lists. The feature supports an agent-context limit of 1,750 characters and configurable prior-turn history, while older LiveKit versions can use manual context updates. The article argues that improving transcription at the source can prevent downstream mistakes in intent recognition, tool calls, order processing, and CRM records.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.