Augment Your LiveKit Agent with Modal GPUs
Blog post from Modal
Modal describes integrating LiveKit Agents with open-weight or custom models on serverless GPUs to build WebRTC-based audio-video applications, demonstrated through a video avatar of Modal employee Charles Frye using BitHuman’s Expression Video Avatar and Qwen3-TTS. The setup uses LiveKit’s avatar interface and BitHuman’s self-hosted GPU container, whose launch endpoint connects the avatar to a LiveKit room. Because that endpoint returns immediately after joining while the avatar still needs persistent container access, Modal’s Sticky Sessions provide container affinity for reconnecting WebSocket clients and maintaining session capacity without an active HTTP request. A LiveKit agent creates a session when a participant joins, invokes the avatar endpoint with a session token, and closes the session after the call, while GPU snapshots reduce cold-start delays by avoiding repeated loading of large model weights.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Serverless | 1 | 1,385 | 326 | 109 | +13% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.