Building secure and scalable production apps with OpenAI’s Realtime API

The OpenAI Realtime API is designed for building advanced multimodal conversational experiences, but it has three key pain points that need to be solved before its use in production applications: user-facing credentials, logging, and evaluations. To address these challenges, Braintrust has released an AI proxy that securely manages the OpenAI API key, issuing temporary credentials to the backend and frontend, thereby offloading infrastructure burden and allowing developers to focus on building their app. The proxy also provides logging capabilities, enabling developers to view logs for LLM calls and multimodal content in a unified format.