Introducing Opik’s Generative Dashboard Builder
Blog post from Comet
Opik has introduced generative dashboards, a feature powered by its conversational AI assistant, Ollie, that lets users create custom monitoring widgets for AI agents through plain-language requests rather than manual SQL queries and chart design. Ollie translates requests into read-only SQL queries against ClickHouse data, analyzes the results, and proposes Vega-Lite visualizations that can be added, resized, shared, and later refined through further conversation. The feature is intended to help teams track organization-specific metrics across trace, span, thread, experiment, and feedback-score data. In an automotive example, a team uses Ollie to compare hallucination scores for vehicle-specification responses across agent versions and then converts the comparison into time-series trendlines, allowing it to identify declining accuracy, investigate relevant traces, and potentially fix or roll back problematic releases. Generative dashboards are generally available in Opik for users with free or existing accounts.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Agent Evaluations | 1 | 168 | 81 | 34 | -20% |
| LLM | 1 | 6,513 | 1,228 | 231 | +8% |
| Voice AI | 1 | 2,730 | 255 | 54 | -20% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.