Export TrueFoundry AI Gateway traces to Opik with OpenTelemetry

TrueFoundry AI Gateway can mirror its OpenTelemetry traces to Comet’s Opik platform, allowing teams to inspect and evaluate LLM requests—including prompts, outputs, token usage, latency, costs, model calls, and tool calls—without modifying application code. Since the gateway sits in front of model traffic and supports more than 1,000 LLMs through an OpenAI-compatible API, gateway-level tracing provides centralized visibility across services while retaining default trace storage in TrueFoundry. Setup requires an Opik API key, workspace, and project, followed by enabling the HTTP OTLP traces exporter in the TrueFoundry dashboard with Opik’s endpoint and required authorization, workspace, and project headers; metrics export should remain disabled because Opik accepts traces rather than OTLP metrics. Once configured, requests appear in Opik as chat-completion traces or nested agent traces, enabling end-to-end debugging, production-based evaluations, and analysis of slow or costly calls.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.