Tracing multimodal AI pipelines with OpenTelemetry: Pixeltable + Langfuse, Phoenix and MLflow
Blog post from Pixeltable
Pixeltable’s optional OpenTelemetry integration creates one trace for each table operation, such as inserts, updates, queries, and computed-column backfills, with nested spans describing catalog, storage, SQL, UDF, media, row, and iterator work at configurable detail levels. Its spans use `pxt.*` attributes to identify tables, columns, UDF paths, resource pools, retries, row counts, and media activity, while provider-specific instrumentation can add child LLM spans containing prompts, completions, and token usage. Context propagation across asyncio tasks, schedulers, and worker threads allows model calls in computed columns and multimodal pipelines to remain properly nested within the originating operation. The separate, opt-in bridge can export standard OTLP traces to Langfuse, Arize Phoenix, MLflow, or a custom collector, with setup choices affecting endpoints, authentication, protocols, and flushing behavior. The discussion distinguishes Pixeltable’s local catalog and lineage data from exported telemetry, notes that sensitive prompts and outputs may travel in LLM spans, recommends collectors for redaction, and warns against duplicate provider instrumentors, excessive trace-level spans for long videos, and Langfuse’s default filtering of Pixeltable spans.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| OpenTelemetry | 18 | 859 | 176 | 64 | +21% |
| LLM | 7 | 6,548 | 1,236 | 233 | +8% |
| Observability | 6 | 3,071 | 738 | 185 | +11% |
| Data Pipeline | 1 | 401 | 160 | 72 | +47% |
| Real-time | 1 | 4,158 | 1,095 | 238 | -14% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.