Project Rosetta Stone: a reference implementation for instrumenting agents in any framework
Blog post from Arize
Project Rosetta Stone serves as a comprehensive reference implementation designed to integrate observability across multiple agent frameworks, providing a single repository featuring the Wonder Toys agent. This reference agent is implemented across 22+ frameworks, each available in three observability tiers: baseline, Phoenix, and Arize AX, allowing users to easily clone, run, and compare the instrumented setup with a no-observability baseline. The Wonder Toys agent mimics a realistic chat-to-purchase scenario, offering functionalities such as product search, purchase, and order tracking with real retrieval and user session features. The project supports various languages and frameworks, including Python, TS/JS, and Java, with consistent observability through OpenInference-shaped spans, ensuring that different frameworks yield compatible traces and dashboards. This setup is particularly beneficial for organizations employing multiple frameworks, allowing for unified monitoring and evaluation pipelines. As the framework ecosystem evolves, Project Rosetta Stone is designed to adapt and expand, encouraging contributions to keep up with new developments and framework-specific requirements.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Observability | 9 | 3,430 | 674 | 183 | +0% |
| LLM | 5 | 5,172 | 1,006 | 220 | -43% |
| AI Agents | 4 | 4,874 | 1,103 | 240 | -1% |
| Real-time | 3 | 5,457 | 1,338 | 238 | -5% |
| OpenTelemetry | 2 | 701 | 153 | 53 | -26% |
| Vector Search | 2 | 2,091 | 556 | 118 | -8% |
| Platform Engineering | 1 | 1,249 | 211 | 81 | -3% |
| RAG | 1 | 885 | 228 | 95 | -58% |