Your Pydantic AI agents just gained a voice

Pydantic AI has introduced realtime voice support that lets existing Python Agent objects conduct low-latency, speech-to-speech conversations through a provider-agnostic API supporting OpenAI Realtime, Azure OpenAI, Gemini Live, and xAI Grok Voice. Audio can be handled on a server or sent directly between browsers and supported providers through WebRTC while the backend retains control of tools, conversation history, and API credentials. Voice sessions use the same server-side typed tools, validation, retries, usage limits, message formats, and observability as text agents, with live audio, transcripts, and tool calls managed through a RealtimeSession. Canonical message history enables voice calls to continue prior text conversations or be passed to another agent for tasks such as structured support-ticket extraction. Provider capabilities are normalized through a shared interface, while the Pydantic AI Gateway can centralize keys, routing, and spending controls across voice and text workloads. Logfire and other OpenTelemetry-compatible tools can trace sessions, transcripts, tool activity, dropped audio, token usage, and costs, which is particularly relevant because unattended realtime audio calls may accumulate charges quickly.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.