A better way to monitor your AI agents in .NET apps

Sentry.Extensions.AI is a new SDK designed to facilitate the monitoring of AI agents in .NET applications by integrating with Microsoft.Extensions.AI.Abstractions. This tool allows developers to instrument and monitor large language model (LLM) interactions, including LLM calls, inputs and outputs, token usage, model names, tool calls, and related issues, all of which are captured as spans and events in Sentry. This integration provides comprehensive visibility into AI behavior by correlating it with application activities such as HTTP requests and database queries, without altering the application's logic. By utilizing the AI.Abstractions package, which serves as a foundational layer for generative AI in .NET, users can implement any LLM library that supports the IChatClient interface. Sentry.Extensions.AI wraps existing IChatClient instances, automatically instrumenting LLM calls and tool invocations. It adeptly handles streaming responses and multi-step tool-call loops, ensuring minimal overhead and seamless integration. The system also introduces the concept of an agent span, which encapsulates the entire LLM interaction loop, providing insights into the complete workflow. Looking ahead, the integration with Microsoft.Extensions.AI.Abstractions is poised to extend its capabilities to track complex multi-step agent workflows and enhance observability in upcoming AI frameworks like Microsoft.Agents.AI and Semantic Kernel, positioning Sentry.Extensions.AI as a standard for monitoring .NET AI workloads.