Observability as code for AI apps with New Relic and Pulumi
Blog post from New Relic
Integrating New Relic's observability platform with Pulumi's infrastructure-as-code enables a comprehensive "observability as code" approach for AI applications, allowing teams to programmatically define monitoring instrumentation, securely manage credentials, and automatically deploy New Relic tools alongside AI infrastructures. This method provides consistent monitoring across environments, facilitates version-controlled observability configurations, and enhances detection of performance issues and insights into AI model behavior. Pulumi offers tools like infrastructure as code (IaC), cloud services, and Environments, Secrets, and Configuration (ESC) for secure management of sensitive data, while Pulumi Copilot aids in generating Python code for infrastructure setup. The guide demonstrates how to implement AI and LLM monitoring in an AI chat application using these tools, with deployment on AWS and monitoring via New Relic dashboards, capturing detailed telemetry data to ensure compliance, quality, and cost control.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Coding Assistant | 12 | 706 | 110 | 47 | +46% |
| Observability | 12 | 1,798 | 331 | 106 | +34% |
| LLM | 10 | 4,030 | 486 | 147 | +1% |
| Secrets Management | 7 | 1,293 | 110 | 55 | +48% |
| RAG | 2 | 1,966 | 260 | 82 | -21% |
| Vector Search | 2 | 3,701 | 290 | 90 | +59% |
| Serverless | 1 | 676 | 180 | 85 | +28% |
| Voice AI | 1 | 456 | 65 | 21 | +65% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.