June 2024 Summaries

To effectively leverage artificial intelligence for IT operations (AIOps), it is crucial to prioritize data quality and completeness. The challenges of managing vast amounts of diverse data from various sources include volume, variety, silos, noise, redundancy, data integrity, and manual processes. Observability plays a vital role in breaking down silos, providing contextual insights, real-time analysis, automation, and enhanced data quality. To achieve AI-readiness, it is essential to define clear objectives, audit your data, implement observability, establish data governance, and continuously improve your data strategy. By being deliberate with your data intentions and focusing on collecting relevant, actionable data, you can unlock the full potential of AIOps for your organization.

Artificial intelligence for IT operations (AIOps) is revolutionizing the industry by enhancing efficiency, reducing downtime, and offering predictive capabilities to preemptively address issues, but its success heavily depends on the quality and completeness of data. Data quality challenges include managing vast and diverse data volumes, breaking down data silos, reducing noise and redundancy, maintaining data integrity, and minimizing manual errors. Observability plays a crucial role by providing comprehensive insights into system states, enabling unified data collection, real-time analysis, and automation, all of which enhance data quality and support AIOps. Achieving AI-readiness involves defining clear objectives, auditing data, implementing advanced observability solutions, establishing data governance, and focusing on continuous improvement. IT leaders must guide their teams to align data strategies with business goals, maximizing the potential of AIOps to drive efficiency, innovation, and competitive advantage.

At Closegap, a nonprofit tech startup, they provide a free tool to support the mental health of thousands of students across the United States. The tool, which includes a free mental health check-in for K-12 students, has helped prevent suicides and uncovered cases of self-harm, bullying, and home issues that could have otherwise gone unnoticed. Closegap uses New Relic as an observability tool to monitor their website's performance and identify potential issues, such as technical debt that was impacting their server costs. The company is also exploring the Hotwire approach to simplify development and build a mobile app with a smaller team. They plan to open-source the application to create an open-source community and share their experience with developers who share their values and mission. Closegap's goal is to improve youth mental health by transforming the way kids are cared for in school, and they're committed to driving equitable access to technology through their Observability for Good Social Impact program.

New Relic AI is a platform that reduces the learning curve for understanding system architecture and makes it easier to onboard, analyze, troubleshoot, and debug using natural language prompts and platform-wide integrations. It utilizes cutting-edge large language models to convert natural language questions into New Relic Query Language (NRQL) queries, but requires additional instructions to perform as expected. The AI uses user-based context and few-shot prompting techniques to generate NRQL queries based on natural language inputs. To address potential errors, the platform employs validation services that check generated queries and provide feedback loops for improvement. New Relic AI continuously tests its performance and optimizes resource usage by limiting query time ranges, selecting representation formats, and providing short responses. The platform is designed to balance cost and complexity while ensuring seamless end-user experiences through ongoing improvements and integrations with other tools and features.

Closegap is a nonprofit tech startup focused on enhancing youth mental health through a free tool that supports K-12 students in developing social-emotional skills and provides schools with real-time monitoring data. Operating across all 50 states, the organization has facilitated over 7 million mental health check-ins and has played a crucial role in identifying and addressing serious student issues. Donald McKendrick, the Director of Technology, manages the technical operations with a focus on maintaining efficient and cost-effective infrastructure, aided by tools like New Relic for monitoring and optimizing performance. Closegap is transitioning its technology stack to Hotwire to streamline development and is planning to open-source its application to foster a community of developers who share its mission. The organization is committed to equitable access to technology and leverages observability tools to enhance its social impact while managing costs efficiently.

As modern systems become more complex and distributed, understanding an organization's system architecture and effectively utilizing tools like New Relic requires overcoming a learning curve, especially with its proprietary query language, NRQL. New Relic AI addresses this by using large language models, such as OpenAI's GPT-4 Turbo, to translate natural language queries into NRQL, aiding both technical and non-technical stakeholders in analyzing telemetry data. The AI assistant employs techniques like prompt engineering and few-shot prompting to improve query accuracy, while a feedback loop helps correct syntactical errors. Despite these advancements, challenges such as syntax hallucinations and question ambiguity persist, necessitating strategies like context-driven understanding and ongoing performance optimization. The AI's ability to handle custom events and attributes in a flexible NRDB environment is balanced with considerations of cost and complexity, ensuring efficient resource use. Continuous improvement efforts focus on enhancing the AI assistant's capabilities, including more integrations for seamless insights and decision-making across organizations.

NVIDIA NIM is a set of cloud-native microservices that provide pre-built, optimized large language models (LLMs) for deployment across NVIDIA accelerated infrastructure in data centers and clouds. This eliminates the need to optimize models for different infrastructure, creating APIs for developers to build applications, and maintaining security and support for these models in production. New Relic AI Monitoring seamlessly integrates with NVIDIA NIM, providing full-stack observability for applications built on a wide range of LLMs, including Meta's Llama 3, Mistral Large, and Mixtral 8x22B. The integration helps organizations confidently deploy and monitor AI applications, accelerate time-to-market, and improve ROI.

Generative AI applications powered by large language models (LLMs) offer significant potential in various industries, yet their development and deployment can be complex. NVIDIA and New Relic have partnered to simplify this process through NVIDIA NIM, a component of NVIDIA AI Enterprise, which provides cloud-native microservices that offer optimized LLM models as containers for easy deployment on diverse platforms. New Relic AI Monitoring integrates with NVIDIA NIM to deliver comprehensive observability for these AI applications, supporting models like Meta's Llama 3 and Mistral Large, among others. This collaboration enables organizations to efficiently deploy and monitor AI applications, accelerating time-to-market and improving return on investment while maintaining robust security and data privacy. By leveraging streamlined deployment and comprehensive monitoring, businesses can enhance their generative AI applications' performance and cost-effectiveness, marking a significant advancement in making AI technology more accessible.

The text highlights the importance of adopting an insights-driven approach in organizations, where data programs are expanding beyond traditional enterprise reporting to include actionable insights in business operations. To ensure high-quality data and meet business-critical functions' reliance on accurate data, organizations must establish service level agreements (SLAs) on datasets, dashboards, reports, and actionable insights provided by the Enterprise Data Warehouse (EDW). The concept of data pipeline observability is introduced, referring to the ability to track, monitor, and alert on the status of data pipelines and data quality. This enables teams to identify issues in the pipeline, fine-tune, and redesign queries or Directed Acyclic Graphs (DAGs) to ensure continuous integrity and reduce downtime. The text emphasizes the need for a comprehensive observability framework that monitors each step in the pipeline, covering all dimensions of data quality, such as freshness, volume, lineage, accuracy, and schema.

Organizations are increasingly focusing on insights-driven approaches, expanding data programs beyond traditional reporting to include actionable insights in business operations like customer acquisition and retention. This shift highlights the importance of reliable data egress pipelines to ensure high-quality, timely insights for critical business functions. Unreliable pipelines pose risks such as missed marketing opportunities and customer churn, prompting businesses to establish service level agreements (SLAs) for data quality and availability. Data pipeline observability, which involves tracking and monitoring data pipelines, is crucial for identifying and resolving issues quickly, thereby minimizing data downtime and its associated costs. By implementing observability frameworks, organizations can ensure data integrity and faster time-to-insights, with proactive interventions made possible through early detection of issues. The concept of "shift left" allows data quality checks to be performed earlier in the process, enhancing efficiency and reducing the effort needed for problem resolution. The blog emphasizes the need for a comprehensive observability framework and suggests New Relic as a tool for monitoring the entire data and engineering stack.

The AI landscape is continually evolving, and with each advancement comes the promise of greater efficiency, improved performance, and reduced costs. OpenAI's latest offering, GPT-4o, has been positioned as a transformative leap forward, especially for businesses leveraging compound AI systems. GPT-4o offers faster response times, lower operational costs, and enhanced capabilities in areas such as natural language processing and multilingual support. However, transitioning to a new model is a complex decision that requires careful consideration. To evaluate GPT-4o effectively, it's essential to understand its key features and expected benefits, including analysis capabilities, resource efficiency, usability and integration, accessibility and pricing. The transition from GPT-4 Turbo to GPT-4o has shown mixed results, with performance degrading over time due to increased usage. Businesses must assess their specific needs and goals, considering factors such as throughput and latency needs, quality of outputs, integration with tools, cost, token efficiency, rate limits and usage, and scalability. By carefully evaluating these factors, businesses can make an informed decision that aligns with their operational needs and ensures both optimal performance and cost efficiency.

The Query Your Data UI in New Relic has been redesigned to provide a more convenient, powerful, and helpful experience for users. The new interface combines rich chart editing features with the portability of the NRQL console bar, making it easier to troubleshoot, explore data, unlock insights, and connect anything and visualize everything. Users can now browse anywhere in New Relic without losing their query, use tabs to interact with multiple queries simultaneously, view context behind visualizations, minimize, resize, and customize their view, and access shortcuts and AI-powered natural language querying. The new experience is designed to empower every team member to find answers from data without requiring NRQL knowledge.

OpenAI's GPT-4o is touted as a significant advancement in AI, promising improved efficiency, speed, and cost-effectiveness, particularly for businesses using compound AI systems. New Relic is evaluating a transition from GPT-4 Turbo to GPT-4o for its AI assistant, considering factors like performance metrics, integration challenges, and cost efficiency. Initial tests reveal that GPT-4o offers faster processing and lower operational costs while excelling in multilingual support and natural language processing. However, potential drawbacks include increased token usage and integration complexities. Despite its advertised benefits, GPT-4o's performance may degrade under high demand, necessitating careful consideration of specific business needs and objectives before adopting it. GPT-4 Turbo remains a reliable option for consistent performance, while GPT-4o is more cost-effective and efficient in multilingual contexts, though it may require adjustments in workflows and incur additional costs.

New Relic has introduced a redesigned Query Your Data UI, enhancing the platform's data exploration capabilities with a more intuitive and efficient interface. This update merges the chart editing features of the old query builder with the NRQL console bar's portability, enabling faster insights and seamless data navigation across New Relic. Key features include a persistent query bar, multi-query tabs, improved caching for quicker loading times, and AI-powered natural language querying that eliminates the need for NRQL knowledge. Users can now connect and visualize data from various New Relic accounts, customize their querying experience with shortcuts and flexible viewing options, and utilize recommended queries to facilitate data exploration. The interface aims to empower all team members to extract insights efficiently, making the querying process both effective and enjoyable.

New Relic has introduced significant updates to its cloud host monitoring capabilities, simplifying the setup process for Amazon EC2 and Azure VM instances without requiring complex configuration or infrastructure agent installations. The new features provide enhanced visibility into cloud host infrastructure, enabling users to monitor performance, resource utilization, and health status of their cloud host resources in a unified view. With the introduction of single entities for each cloud host resource, regardless of instrumentation approach, New Relic empowers organizations to effectively monitor and manage their Amazon EC2, Azure VM, and GCP CE infrastructure with confidence, leveraging simplified monitoring experiences and unified insights to optimize cloud environment performance and address potential issues.

New Relic has introduced a click-to-parse capability for log management, allowing users to easily select and parse out repeatable values from string attributes without writing additional script. This feature automates and streamlines the end-to-end query process, increasing productivity and reducing errors. Unlike other observability platforms that rely on manual input, New Relic's approach is pre-configured for immediate value through increased productivity. The click-to-parse capability can be used to extract values from any log format, making it a valuable tool for DevOps, security, and compliance professionals who need to navigate vast lines of log data to find valuable insights.

New Relic has enhanced its cloud host monitoring capabilities for Amazon EC2 and Azure VM instances, streamlining the monitoring process by eliminating the need for manual infrastructure agent installations. These updates allow for agentless monitoring using Amazon CloudWatch Metric Streams and Azure Monitoring integration, providing comprehensive insights into performance, resource utilization, and health without complex setups. Additionally, a unified entity creation for cloud host resources simplifies navigation and troubleshooting by consolidating monitoring data, regardless of the instrumentation method used. This improvement facilitates easier monitoring and management of Amazon EC2, Azure VM, and GCP CE instances across multi-cloud environments, enhancing reliability, performance, and scalability. These updates empower organizations to effectively oversee their cloud infrastructure, offering a straightforward setup and unified visibility, ensuring optimal cloud host environments.

New Relic has introduced a new click-to-parse feature for log management, enabling users to easily select and parse values from log files without manual input or additional scripting. This feature is designed to enhance productivity and reduce errors by automating the query process, setting it apart from other platforms like Dynatrace, AppDynamics, and Datadog, which rely on manual input. By allowing users to parse any log format, not just JSON, New Relic's solution simplifies the process of extracting valuable insights from log data, akin to navigating a treasure hunt as depicted in the anime series "One Piece." The feature is integrated into the New Relic Query Language (NRQL) and provides a streamlined process for defining and managing parsing rules, ultimately resulting in a more efficient analysis of IT environments.

The .NET Aspire is a cloud-ready stack for building observable and production-ready distributed applications, including features like a developer dashboard, tooling and orchestration, and components that facilitate integration with prominent services and platforms. It aims to solve challenges such as complexity, getting started, choices, and paved paths in cloud-native application development. The .NET Aspire includes a curated suite of NuGet packages, project templates, and tooling experiences for Visual Studio and the dotnet CLI. To send telemetry to an OpenTelemetry backend like New Relic, users can configure OpenTelemetry correctly by leveraging SDKs and environment variables, providing necessary configuration such as the OTLP endpoint, headers, and service name, and then starting the Aspire application with the correct command.

.NET Aspire, introduced at .NET Conf 2023, is a cloud-ready stack designed to simplify the development of observable and production-ready distributed applications. It tackles challenges such as the complexity of cloud computing and the overwhelming choices developers face, by providing a streamlined path with a curated suite of NuGet packages for easy integration with services like Redis and PostgreSQL. The stack includes a developer dashboard for real-time monitoring of application aspects, tooling for Visual Studio and the dotnet CLI, and orchestration features for managing multi-project applications. The blog post focuses on configuring OpenTelemetry to send data to an observability backend like New Relic, using a forked version of the eShop application as a reference; it provides guidance on setting environment variables and configuring the app for effective telemetry data collection and analysis.

New Relic has introduced several parsing and transformation functions for its Query Language (NRQL) to help users easily extract data from unstructured sources. These functions include `jparse()` for parsing JSON, `toTimestamp()` and `toDatetime()` for converting timestamps, `cidrAddress()` for mapping IP addresses, `encode()` and `decode()` for Base64 encoding and decoding, and `convert()` for converting units of measurement. These new functions aim to simplify data analysis by providing a more straightforward way to work with various data formats, making it easier to build dashboards and alerts, regardless of the original structure of the data.

New Relic has introduced several parsing and transformation functions to enhance data querying in the New Relic Query Language (NRQL), enabling users to more easily process and visualize unstructured data. These new functions include jparse(), mapKeys(), and mapValues() for parsing JSON, toTimestamp() and toDatetime() for converting timestamps, cidrAddress() for mapping IP addresses, encode() and decode() for Base64 conversions, and convert() for unit conversions. These tools aim to simplify tasks that were previously complex, such as extracting specific data points from JSON, converting epoch time to human-readable formats, and handling Base64 encoded data, allowing for more efficient dashboard creation and alert management. The enhancements are designed to assist data teams, such as DevOps, in handling data that may not be optimally stored, streamlining the process of cleaning and analyzing data without requiring pre-ingestion modifications.

New Relic mobile monitoring provides complete visibility into the performance and troubleshooting of Android, iOS, and hybrid mobile applications, enabling developers to ensure consistent availability and excellent user experiences in today's competitive market. The solution tracks performance metrics, identifies shortcomings, and analyzes time-series data to prevent and resolve issues that affect a seamless user experience. Essential metrics include application start times, service map, geographic distribution, distributed transactions, crashes, change tracking, errors inbox, and user journeys, providing insights into app performance and health. By leveraging these metrics, developers can identify bottlenecks, understand how data flows across their architecture, and quickly solve issues to improve application durability and customer satisfaction.

New Relic mobile monitoring offers comprehensive visibility into the performance and troubleshooting of Android, iOS, and hybrid mobile applications, which is crucial in today's competitive market where businesses rely heavily on mobile apps for engagement and revenue. The monitoring solution tracks key performance metrics such as application start times, crashes, and distributed transactions, providing insights into user experience and highlighting areas for improvement. It also features tools like service maps and geographic distribution reports to identify bottlenecks and user demographics, while distributed tracing and error tracking enhance the diagnosis and resolution of performance issues. New Relic facilitates enhanced observability by capturing offline telemetry data, enabling change tracking, and offering a user-friendly errors inbox to prioritize and address problems efficiently. The platform supports various integrations and provides resources for monitoring applications developed with frameworks like React Native and Flutter, aiming to improve application durability and customer satisfaction through robust observability practices.