Home / Companies / Pixeltable / Blog / Post Details
Content Deep Dive

Tracing multimodal AI pipelines with OpenTelemetry: Pixeltable + Langfuse, Phoenix and MLflow

Blog post from Pixeltable

Post Details
Company
Date Published
Author
Pierre Brunelle
Word Count
2,425
Company Posts That Month
11
Language
English
Hacker News Points
-
Post removed?
No
Summary

Pixeltable’s optional OpenTelemetry integration creates one trace for each table operation, such as inserts, updates, queries, and computed-column backfills, with nested spans describing catalog, storage, SQL, UDF, media, row, and iterator work at configurable detail levels. Its spans use `pxt.*` attributes to identify tables, columns, UDF paths, resource pools, retries, row counts, and media activity, while provider-specific instrumentation can add child LLM spans containing prompts, completions, and token usage. Context propagation across asyncio tasks, schedulers, and worker threads allows model calls in computed columns and multimodal pipelines to remain properly nested within the originating operation. The separate, opt-in bridge can export standard OTLP traces to Langfuse, Arize Phoenix, MLflow, or a custom collector, with setup choices affecting endpoints, authentication, protocols, and flushing behavior. The discussion distinguishes Pixeltable’s local catalog and lineage data from exported telemetry, notes that sensitive prompts and outputs may travel in LLM spans, recommends collectors for redaction, and warns against duplicate provider instrumentors, excessive trace-level spans for long videos, and Langfuse’s default filtering of Pixeltable spans.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
OpenTelemetry 18 859 176 64 +21%
LLM 7 6,548 1,236 233 +8%
Observability 6 3,071 738 185 +11%
Data Pipeline 1 401 160 72 +47%
Real-time 1 4,158 1,095 238 -14%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.