August 2025 Summaries

Errors in distributed systems often manifest through failed operations or user dissatisfaction, and identifying their root causes is crucial but challenging due to the interdependent nature of services and constant deployments. The financial impact of downtime is significant, with costs rising to thousands of dollars per minute, emphasizing the need for efficient error analysis and resolution. Traditional monitoring, focused on logs and metrics, is reactive and can lead to alert fatigue, data overload, and fragmented views, which hinder incident response. Observability, by integrating traces, structured logs, metrics, events, and context, allows for a more proactive approach, enabling teams to trace the root causes of errors systematically and reduce mean time to recovery (MTTR). The blog outlines a step-by-step framework for root cause analysis (RCA), which is enhanced with observability platforms like New Relic, demonstrating improved incident response through integrated alerts, traces, logs, and change events. By following a structured approach supported by observability tools, teams can minimize outages, improve customer trust, and increase system reliability.

Modern distributed systems face complex challenges when diagnosing errors, as they often involve interconnected services and constant deployments that can amplify small failures into larger issues, leading to significant financial losses during outages. While traditional monitoring tools provide snapshots of logs and metrics, they are often reactive and siloed, lacking the ability to connect the dots across systems. Observability, however, integrates traces, structured logs, and context into a unified fabric, enabling teams to pinpoint root causes more effectively and reduce mean time to resolution (MTTR). A structured approach to error analysis involves tracing the issue from the symptom through to the root cause using tools like New Relic, which offers an integrated workflow of alerts, logs, and traces. This methodology not only accelerates problem resolution but also enhances system reliability and customer trust by providing comprehensive insights into system behavior, supported by the use of observability platforms to streamline the investigative process.

New Relic's Cardinality Control, now generally available, offers a breakthrough in monitoring complex, distributed systems by allowing IT operations teams to manage high-fidelity data without the prohibitive costs traditionally associated with high-cardinality data ingestion and analysis. This capability provides a generous baseline of 15 million cardinality per account, enabling comprehensive data collection and analysis for effective root cause analysis and troubleshooting, especially in network monitoring scenarios. Cardinality Control eliminates the need for data sampling and artificial limits, thereby enhancing visibility and enabling a shift from reactive to proactive system optimization. This innovation empowers teams to focus on comprehensive coverage that reflects their system's complexity, facilitating the identification of performance trends, capacity planning opportunities, and optimization targets. With its user-friendly UI and alerting capabilities, Cardinality Control ensures predictable costs and complete observability, transforming how IT operations teams approach monitoring and incident resolution.

New Relic's Cardinality Control introduces a transformative approach to managing high-cardinality data for IT operations teams, allowing them to handle complex network monitoring without the traditional cost and data limitations. By providing a baseline of 15 million cardinality per account, this capability enables comprehensive data collection and analysis, removing the constraints of sampling or aggregation and ensuring detailed visibility into system behaviors. This advancement allows teams to focus on root cause analysis and proactive system optimization rather than managing data volume trade-offs, significantly enhancing the ability to track performance metrics across extensive network infrastructures. Cardinality Control facilitates a shift in observability strategy, enabling organizations to maintain predictable costs while achieving complete system visibility, thus supporting more effective incident resolution and capacity planning.

New Relic's upcoming Cloud Cost Intelligence (CCI) platform aims to provide DevOps, FinOps, and platform engineering teams with real-time visibility into cloud expenditures across multi-cloud and Kubernetes environments, integrating cost analysis directly within the New Relic platform. This observability-driven FinOps tool enables teams to analyze spend, detect anomalies, and align costs with business outcomes by offering real-time cost estimates, customizable insights, and smart cost allocation without relying on outdated billing reports. CCI allows organizations to establish financial governance through comprehensive budgeting and provides deep insights using the flexible NRQL query language, helping to identify cost anomalies and optimize resource use. The tool, which is designed to bridge observability with cost-aware engineering, will soon be available to users, offering features such as seamless integration with notification workflows and the ability to explore cloud cost data through an intuitive dashboard interface.

New Relic is introducing its Cloud Cost Intelligence (CCI) tool, which aims to provide DevOps, FinOps, and platform engineering teams with real-time visibility into cloud spending across multi-cloud and Kubernetes environments, enabling cost analysis, anomaly detection, and alignment with business outcomes. This integration within the New Relic platform offers observability-driven FinOps, allowing teams to seamlessly connect cloud cost insights with operational telemetry without the need for separate tools. CCI provides dashboards for real-time cost estimation, customizable filters for detailed insights, and a rule-based engine for smart cost allocation, empowering teams to manage budgets effectively and take immediate action on cost anomalies and underutilized resources. The tool enables teams to leverage NRQL for creating custom views and integrates with notification workflows for automatic response to cost spikes, thus facilitating a unified approach to cloud cost management that aligns with strategic business goals.

New Relic has enhanced its platform by integrating Core Web Vitals (CWV) with Session Replays to improve website performance analysis and troubleshooting. This integration allows developers to view key performance metrics like Largest Contentful Paint (LCP) and Interaction to Next Paint (INP) directly on replay timelines, providing context to identify performance bottlenecks during user sessions. This feature simplifies the process by adding a Session Replays column to CWV dashboards, enabling users to see session replays related to specific issues across various dimensions. It prioritizes sessions with critical CWV issues, helping developers quickly pinpoint and resolve the root causes of performance problems, ultimately enhancing user experiences and reducing churn. This new capability is available to all New Relic users with Browser entity instrumentation and Session Replays enabled, and it builds on New Relic's commitment to delivering better user experiences by facilitating faster problem resolution.

New Relic has introduced an integration that connects Core Web Vitals (CWV) with Session Replays to streamline the process of identifying and resolving website performance issues. This integration allows developers to view key performance metrics, such as Largest Contentful Paint (LCP) and Interaction to Next Paint (INP), on the replay timeline, providing insights into when and where performance bottlenecks occur during user sessions. By adding a Session Replays column to CWV dashboards, users can see the number of session replays linked to specific performance issues across various dimensions, enabling them to quickly pinpoint root causes and prioritize customer-impacting problems. This feature, available to all New Relic users with Browser entity instrumentation and Session Replays enabled, aims to improve digital experiences by facilitating faster troubleshooting and resolution of customer issues.

As the demand for real-time insights into application performance and security grows within digital ecosystems, the importance of observability and skilled professionals in this field becomes increasingly crucial. New Relic has responded to this need by launching its Observability Certification Program, which offers four role-based certifications: New Relic Verified Foundations (NVF), New Relic Certified APM Practitioner - Associate (APA), New Relic Certified Performance Engineer - Professional (PEP), and New Relic Certified Reliability Engineer - Professional (REP). These certifications are designed to validate and enhance proficiency in deploying, using, and managing the New Relic platform, thereby boosting career opportunities and organizational innovation. By offering a structured learning path and various preparation courses, the program aims to provide participants with the expertise needed to optimize digital environments and maintain effective IT operations. The certifications are delivered through online exams with varying levels of proctoring to ensure integrity and are recognized for their role in advancing professional development within the observability industry.

In the rapidly advancing digital landscape, the demand for skilled professionals in observability—a practice that offers deep insights into system performance—is increasing, prompting New Relic to launch its Observability Certification Program. This program aims to validate expertise in deploying and managing the New Relic platform, which is critical for enhancing application performance and reliability. It offers four role-based certifications—New Relic Verified Foundations, Certified APM Practitioner, Certified Performance Engineer, and Certified Reliability Engineer—each tailored to different levels of expertise within the field. The certifications, administered through online exams, are designed to boost career opportunities, validate skills, and promote innovation in digital ecosystems. The program is supported by various learning resources and paths to help candidates prepare and succeed, while also enabling them to connect with a community of certified professionals.

New Relic emphasizes the transformative potential of Artificial Intelligence (AI) in business operations, focusing on responsible and ethical AI deployment. The company has introduced AI Principles that prioritize human-centric design, fairness, transparency, privacy, security, and accountability. These principles aim to build trust in AI systems by ensuring they are fair, transparent, secure, and accountable, thus enabling businesses to leverage AI effectively while maintaining confidence in its use. By adhering to these principles, New Relic seeks to deliver AI-enhanced features that drive innovation and provide reliable insights, fostering trust and security in data handling. The company's commitment to responsible AI is seen as essential for sustainable growth and innovation, with the goal of empowering businesses through trusted AI solutions.

New Relic emphasizes the transformative potential of Artificial Intelligence (AI) in enhancing business operations and driving innovation while highlighting the importance of responsible AI development. The company has introduced new AI Principles that focus on human-centric design, fairness, transparency, privacy, security, accountability, and governance to ensure ethical AI deployment. These principles aim to build trust among users by ensuring AI systems are fair, transparent, and secure, and by providing explanations for AI-driven insights. New Relic is committed to delivering reliable insights, fostering data trust, and innovating ethically, which it believes are essential for sustainable growth and meaningful innovation. The blog post also notes that the views expressed are those of the author, Jessica Hill, and not necessarily New Relic's, and encourages readers to engage with further discussions on the Explorers Hub platform.

Effective management of New Relic license and user API keys is essential for maintaining security and operational efficiency, especially as organizations and their technical environments grow in complexity. The keys, which enable applications and scripts to communicate with New Relic, should be managed by understanding their various types, such as Ingest Keys for telemetry data, Browser Keys for monitoring, and User API Keys for authenticated API access. New Relic offers several tools for key management, including the New Relic UI for manual tasks, the NerdGraph UI for recurring operations with a GraphQL query builder, and the New Relic CLI for automating workflows. Key management best practices include regular key rotation, secure storage, auditing key activity, and applying the principle of least privilege to minimize security risks. These measures help secure data, streamline workflows, and reduce operational risks, aligning with an effective observability strategy.

New Relic Scorecards provide a streamlined method for calculating and tracking DORA metrics—established by Google's DevOps Research and Assessment team—automatically from existing development and operations data. These metrics, which include Deployment Frequency, Lead Time for Changes, Change Failure Rate, and Mean Time to Recovery (MTTR), are crucial for assessing DevOps performance and driving continuous improvement. By using New Relic’s integrations with tools like Change Tracking, GitHub Integration, and NR Issues & Incident Management, organizations can transform raw data into actionable insights, enabling teams to monitor their software delivery performance effectively. The platform offers customizable thresholds and data sources, allowing users to adjust queries to fit specific goals, and supports the grouping of metrics by team for detailed performance analysis. Available with the Advanced Compute add-on, New Relic Scorecards also include additional templates for observability maturity and security, providing a comprehensive solution for tracking and enhancing operational efficiency.

New Relic Scorecards offer a streamlined way to automatically calculate and track DORA metrics, which are essential for assessing DevOps performance in terms of deployment frequency, lead time for changes, change failure rate, and mean time to recovery. The process involves leveraging various integrations within New Relic, such as Change Tracking, GitHub Integration, and Issues & Incident Management, to provide the necessary data for these metrics. Users can easily create DORA Scorecards using templates and customize thresholds to align with specific goals. Additionally, New Relic Teams allows for grouping metrics by service ownership to enhance team-level insights. Beyond DORA metrics, Scorecards also offer templates for other aspects of observability and security, accessible with the Advanced Compute add-on. This functionality is designed to facilitate continuous improvement without the need for manual reporting, and users are encouraged to explore further capabilities through New Relic's platform.

Effective management of New Relic license and user API keys is essential for maintaining smooth operations and robust security, particularly as organizations expand and key management becomes more complex. Understanding the types of keys, such as Ingest, License, Browser, Mobile App Token, and User API Key, is crucial for managing them effectively. New Relic offers several tools for key management, including the New Relic UI for manual tasks, NerdGraph UI for recurring operations, and the New Relic CLI for automation and programmatic management. Best practices for key security include regularly rotating keys, storing them securely, auditing their activity, applying the principle of least privilege, and promptly revoking unused keys. By utilizing these management options and adhering to security practices, teams can secure their data and streamline workflows, reducing operational risks. Lead Developer Relations Engineer Zameer Fouzan emphasizes the importance of keeping up with the latest developer trends and encourages developers to use New Relic's flexible tools to enhance their observability strategy.

Organizations face a significant hidden financial burden known as the "Invisible Tax," which stems from unobserved digital systems that lack actionable data like detailed logs, metrics, and traces, leading to inefficiencies such as prolonged debugging, increased downtime costs, and misguided investments. This Invisible Tax drains engineering budgets, as developers spend about half their time on debugging, and fixing software defects becomes exponentially more costly when detected later in the development cycle. The absence of Observability—a strategic imperative that allows for understanding and diagnosing system issues—leads to longer Mean Time To Resolution (MTTR), affecting user experience and revenue. Observability tools like New Relic can transform these operational challenges into strategic advantages by improving debugging speed, reducing downtime, and enabling data-driven decision-making, which enhances productivity, accelerates delivery, and fosters innovation. Implementing Observability practices can mitigate technical debt, optimize resource allocation, and improve developer satisfaction by reducing repetitive tasks. To eliminate the Invisible Tax, organizations should prioritize Observability, integrate it into planning, and measure its impact through clear success metrics, ultimately turning operational expenditures into strategic investments for growth and competitive advantage.

Organizations face a substantial financial drain termed the "Invisible Tax," which arises from unobserved systems lacking comprehensive telemetry, leading to inefficiencies like prolonged debugging and slower incident resolution. Observability, distinct from traditional monitoring, provides critical insights into system issues, transforming operational challenges into strategic investments. This shift enables faster debugging, reduced downtime costs, and data-driven decision-making, ultimately fostering innovation and improving developer productivity. By investing in Observability tools, businesses can eliminate the Invisible Tax, optimize resources, and gain a competitive advantage, as demonstrated by platforms like New Relic.

Amazon Simple Queue Service (SQS) is an integral part of Event-Driven Architecture, providing a mechanism for message queuing that can be enhanced through observability tools like New Relic's NRQL (New Relic Query Language). The article explores how to monitor SQS metrics beyond basic queue health by using NRQL to build custom dashboards and alerts for message bottlenecks. It highlights key metrics such as ApproximateNumberOfMessagesVisible, NumberOfMessagesSent, NumberOfMessagesReceived, and NumberOfMessagesDeleted, and emphasizes monitoring Dead Letter Queues (DLQs) to identify unprocessed tasks. Additionally, it discusses the importance of managing message sizes to avoid performance bottlenecks and showcases how distributed tracing with New Relic can enhance the efficiency and reliability of Lambda functions interacting with SQS. Finally, it covers integrating New Relic's Lambda Layer for comprehensive telemetry data, enabling deeper insights into the performance and behavior of serverless applications.

Amazon Simple Queue Service (SQS) is a key component in Event-Driven Architecture, offering pre-built dashboards for monitoring via Amazon CloudWatch Metrics Streaming integration. The blog explores how to enhance observability by using New Relic's NRQL (New Relic Query Language) to build dashboards that provide detailed insights into SQS metrics such as message bottlenecks and queue health, including metrics like ApproximateNumberOfMessagesVisible, NumberOfMessagesSent, NumberOfMessagesReceived, and NumberOfMessagesDeleted. It emphasizes the importance of tracking these metrics to ensure the efficient performance of SQS queues, especially in applications using the Lambda-SQS pattern, where distributed tracing can identify bottlenecks and errors. Additionally, it highlights the use of New Relic Lambda Layer for monitoring Lambda functions as they send and receive messages from SQS, offering comprehensive telemetry data for better system optimization. The blog, authored by Jones Zachariah Noel N, a Senior Developer Relations Engineer at New Relic, provides insights into leveraging these tools for enhanced observability and system reliability, while also facilitating the creation of custom dashboards using NRQL for improved performance monitoring.