Protecting data privacy and security while building with generative AI

New Relic AI aims to make observability accessible to all organizations by integrating large language models (LLMs) with a unified telemetry data platform, offering insights, automated alerting, and system optimization without a steep learning curve. Emphasizing data security and privacy, New Relic AI's development involved close collaboration with security, legal, and compliance teams to safeguard customer information at every stage, from initial prompts to final responses. The service carefully manages access rights and data retrieval, ensuring privacy by design and limiting access to necessary functions. It leverages Azure OpenAI for secure LLM capabilities and employs retrieval-augmented generation (RAG) to provide contextual answers from public documentation without exposing user data. New Relic AI is designed to protect customer interactions by restricting conversation context to the active session, preventing cross-user data leaks. By continually assessing vendors and technological advancements, New Relic ensures that its generative AI solutions remain secure and privacy-focused, maintaining a proactive stance on emerging security challenges.