Datadog LLM Observability has been integrated with Google Gemini, allowing users to monitor, troubleshoot, improve, and secure their Google Gemini LLM applications. The platform offers automatic instrumentation for detecting and tracing API calls made by the application without manual annotations, simplifying setup and enabling end-to-end tracing of LLM chain executions. It also provides out-of-the-box quality and safety evaluations for detecting hallucinations, toxic responses, and other issues, as well as real-time metrics to monitor performance and token usage. Additionally, it offers an Operational Insights dashboard for collating key usage metrics, allowing users to quickly focus on sources of errors, latency, and unexpected usage patterns. This integration enables users to gain complete visibility and control over their Gemini applications, ensuring cost efficiency and performance while maintaining compliance with regulations.