Data Fabric: Querying agent traces in BigQuery
Blog post from Arize
Arize's Data Fabric, integrated with Google BigQuery, enables organizations running AI agents in production to seamlessly query and analyze agent traces alongside billing, infrastructure, and customer data by synchronizing these traces to open Apache Iceberg tables. This integration addresses the challenge of disjointed data systems by allowing engineering and data teams to treat AI agent telemetry as structured warehouse data, facilitating SQL-based analysis without the need for custom pipelines or data export. Arize's approach leverages open standards, ensuring no vendor lock-in, and supports efficient querying through schema fidelity and partitioning. The system combines Arize's purpose-built adb OLAP engine with Data Fabric to provide low-latency debugging and a continuously updated record in the warehouse, enabling insights into cost drivers, performance issues, and resource allocation. By joining agent decision data with operational and business datasets, organizations can derive actionable insights that inform both immediate engineering decisions and broader business strategies, though challenges such as data modeling and attribution remain.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 10 | 5,932 | 1,046 | 223 | -2% |
| Observability | 7 | 4,496 | 812 | 176 | +40% |
| Harness engineering | 5 | 164 | 111 | 62 | +6% |
| AI Agents | 4 | 4,430 | 1,100 | 236 | -3% |
| Real-time | 4 | 6,296 | 1,346 | 246 | -2% |
| Data Pipeline | 1 | 770 | 196 | 80 | +5% |
| Serverless | 1 | 678 | 211 | 91 | -7% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.