October 2025 Summaries

Addie Beach discusses the challenges of managing data sprawl in testing ecosystems and proposes integrating test data management into infrastructure platforms like Terraform. This approach helps maintain synchronized testing environments, allows for quick provisioning, and supports robust backups. The author highlights the integration of Terraform with Datadog, enabling the creation and management of synthetic tests, including multi-step API and browser tests, while leveraging global variables and tag policies for consistency and ownership tracking. The text emphasizes the flexibility of using Terraform to customize tests and manage configurations, while also allowing non-technical teams to utilize Datadog's UI for code-free test creation. It suggests using subtests to modularize and simplify test creation across teams, ultimately advocating for treating tests as infrastructure to improve efficiency and reliability in test management.

Datadog CloudPrem is a hybrid log management solution designed to help organizations manage the increasing complexity and volume of log data generated by AI workloads and cloud-native applications. It allows users to retain control over their logs within their own infrastructure while maintaining full integration with the Datadog SaaS platform, offering benefits like centralized governance, AI-powered analysis, and high-performance query capabilities. CloudPrem enables organizations to meet strict data residency and compliance requirements by storing logs in specific regions without sacrificing visibility or functionality. Its modern architecture separates compute from storage, allowing for efficient scaling and cost reduction, while also supporting advanced log processing and enrichment through Datadog Observability Pipelines. By consolidating security workloads and enabling seamless correlation of logs with metrics and traces, CloudPrem helps teams troubleshoot more effectively and make informed decisions, all while maintaining the familiar Datadog experience.

Organizations utilizing containerized environments face intricate security challenges with the scaling of Kubernetes and the adoption of dynamic, ephemeral infrastructure. Traditional security tools often fail to detect activities within containers, leading to difficulties in identifying threats or policy violations at runtime. Falco, a runtime security monitoring tool, addresses this by using eBPF probes and a custom Linux kernel module to detect malicious behavior in real time. Datadog's integration with Falco allows for the forwarding of Falco alerts into Datadog, enabling visualization and analysis of container security events alongside infrastructure metrics, traces, and logs. This integration aids in accelerating investigations by correlating Falco telemetry with infrastructure signals, allowing for more efficient threat analysis and root cause determination. By utilizing Datadog Cloud SIEM, teams can automate remediation workflows and enhance security posture by detecting and analyzing threats such as privilege escalation attacks. This comprehensive approach to security monitoring and incident management empowers organizations to effectively protect their containerized environments while providing real-time insights and reducing mean time to resolution (MTTR).

Datadog BYOC (Bring Your Own Cloud) Logs offers a hybrid log management solution that allows organizations to maintain control over their log data within their own infrastructure while leveraging the full capabilities of the Datadog SaaS platform. This solution addresses challenges faced by teams managing large volumes of telemetry data, such as compliance with data residency laws and the need for scalable and cost-effective log management. It separates compute from storage for efficient scaling, enabling organizations to store and search logs at a petabyte scale without the drawbacks of traditional self-hosted systems. BYOC Logs integrates seamlessly with Datadog's observability tools, providing AI-powered analysis, unified monitoring, and the ability to correlate logs with metrics and traces, which enhances troubleshooting and system health monitoring. Additionally, it supports data residency and compliance requirements, making it suitable for organizations operating under strict data location regulations, while still offering features like RBAC, audit trails, and sensitive data scanning.

Datadog has been recognized as a Leader in the 2025 Gartner Magic Quadrant for Digital Experience Monitoring for the second consecutive year, reflecting its commitment to helping customers manage complex digital environments. Datadog's unified observability and security platform enhances collaboration across business, DevOps, SRE, and security teams by providing deep visibility into user interactions and application performance. The platform employs AI to detect anomalies, track user interactions, and uncover behavioral patterns, facilitating proactive optimization of digital experiences. Key features include Real User Monitoring (RUM), Product Analytics, Session Replay, and integrated error tracking, enabling teams to resolve issues efficiently and make informed product decisions. Additionally, Datadog's AI engine offers automated alerts and insights, enhancing application performance monitoring and service ownership. Customer testimonials highlight Datadog's ability to provide insightful data and measure business impact, which is reflected in its continued investment in scalable data collection and cost controls.

Datadog has introduced a new false positive filtering feature for its Static Code Analysis (SAST), aimed at improving the efficiency of security vulnerability detection by leveraging Bits AI to differentiate between true and false positives. This enhancement helps reduce noise and distractions by classifying vulnerabilities and providing context, allowing development and security teams to focus on genuine threats. The AI-driven feature integrates into Datadog's SAST platform, enabling seamless triage of findings and facilitating transparency through confidence badges and detailed reasoning for each assessment, which users can validate and provide feedback on. By analyzing vulnerabilities in the context of their broader code structure, Bits AI enhances accuracy beyond traditional static analyzers, which often generate false positives due to their risk-averse design. The implementation of this feature is part of Datadog's ongoing investment in AI innovation for improving code security, and it is available to Datadog Code Security customers, with a 14-day free trial for new users.

Datadog has introduced Test Suites for Synthetic Monitoring to help modern teams organize, manage, and scale their synthetic tests more effectively. As organizations expand, they often face challenges in managing a growing number of tests, which can become overwhelming and disconnected. Test Suites address this by allowing teams to group related tests based on user journeys, environments, locations, or services, which mirrors the real-world systems hierarchy and transforms a disorganized list of tests into a structured map of application health. This organization not only simplifies test management and maintenance but also enhances cross-team collaboration, accountability, and clarity of ownership by linking tests to specific teams and services. Test Suites provide a unified view of testing results, enabling proactive management and fostering better alignment between engineering, QA, and leadership teams, ultimately turning raw test data into actionable insights and improving response times and system reliability.

Metrics are essential for experimentation as they help evaluate ideas and guide future directions. Teams collect diverse metrics, but integrating data from various sources can be challenging due to silos. There are two main types of experimental data: event stream data, which provides real-time insights and tracks application performance, and transactional data, which is used for long-term analyses and business metrics. Designing experiments involves setting goal metrics, which tie closely to hypotheses, and driver and guardrail metrics, which are derived from event stream data for immediate insights. Teams also use transactional data for audience selection and post-experiment analysis. Datadog integrates event stream and transactional data into a single platform, facilitating robust experiments and analyses by offering real-time observability and precise business insights. This integration enables cross-team collaboration and efficient decision-making, with Datadog providing tools to visualize and manage experimental data effectively, reducing silos and increasing confidence in results.

Prompt guardrails are essential tools for safeguarding Large Language Model (LLM) applications against security threats such as prompt injection, data exfiltration, and other forms of misuse, by establishing boundaries around acceptable inputs and behaviors. These guardrails operate at various stages, including input validation, prompt construction, and output filtering, to ensure security, safety, and compliance in interactions with generative AI applications. Implementing both security and safety guardrails is crucial, with security guardrails focusing on detecting and mitigating attacks, such as prompt injection and data leakage, while safety guardrails prevent exposure to toxic content. They fit within the LLM application architecture by acting as intermediaries between clients and agents, using methods such as regex-based filters and AI-powered classifiers to detect and neutralize threats. Maintaining least privilege and role isolation is critical to prevent tool misuse and privilege escalation. Continuous monitoring and evaluation of guardrails are necessary to adapt to the evolving exploitation landscape, ensuring their effectiveness in mitigating security risks.

Datadog's External Provider Status offers real-time visibility into the health of over 40 third-party providers, including major SaaS platforms and AWS services, allowing users to detect issues faster than vendor status updates. This tool maps service degradations to a user's architecture, helping teams quickly identify whether issues are external or internal, thus reducing investigation time and improving response times during outages. It integrates with Datadog's ecosystem for targeted notifications, ensuring relevant teams are alerted without unnecessary noise. Additionally, Datadog has launched Updog.ai, a public-facing status page that extends these insights to a broader audience, fostering a shared intelligence community.

Updog.ai is a free, public-facing web page by Datadog that provides real-time health status updates for over 30 popular SaaS providers and 13 AWS services, leveraging aggregated, anonymized observability data and AI models. This platform enables users to independently verify the status of services like OpenAI, Zoom, and GitHub, offering a single dashboard that highlights performance issues or outages as they arise, without relying on vendor-controlled status updates. Updog.ai also provides historical views with up to 90 days of degradation history, which helps identify recurring reliability issues and supports informed decision-making for improved fault tolerance. By analyzing telemetry data from thousands of environments, Updog.ai extends observability beyond individual systems, offering a collective intelligence that surfaces systemic error signals. This AI-driven approach allows Datadog to detect issues faster than vendor-maintained status pages, exemplified by its ability to identify a degradation in Amazon DynamoDB 32 minutes before AWS's own update. Future expansions of Updog.ai are planned to include GPU availability monitoring, spot interruption monitoring, and cyber attack vector monitoring, enhancing its scope as a comprehensive resource for real-time service transparency.

High-performance computing (HPC) environments handle critical tasks such as financial modeling and drug discovery simulations, requiring vast computational resources and specialized infrastructure like GPUs. Traditionally, monitoring these resources separately has led to inefficiencies and delays, but Datadog now offers a comprehensive solution for monitoring HPC workloads and their supporting infrastructure, whether on-premises, cloud-based, or hybrid. By integrating with popular workload managers like Slurm, Datadog provides detailed insights into job execution, resource utilization, and performance metrics for compute, storage, network, and GPU systems. This integration helps teams identify bottlenecks, optimize throughput, and manage costs more effectively. Datadog's platform includes features like a centralized HPC dashboard, cloud cost management, and tools for diagnosing storage and network issues, enhancing overall visibility and enabling more efficient use of HPC resources.

Datadog has integrated large language models (LLMs) into its security workflows to enhance the detection of malicious code changes in pull requests (PRs) at scale, addressing challenges such as growing attack surfaces and reviewer fatigue. This LLM-powered system, named BewAIre, analyzes the intent behind code modifications and provides real-time security signals for Datadog's repositories, achieving over 99.3% accuracy with a minimal false positive rate. By employing prompt engineering, dataset tuning, and recursive chunking of large diffs, Datadog has developed a system that effectively identifies sophisticated attacks, such as the tj-actions breach, by understanding the intent behind code changes rather than just syntax. This initiative represents a shift from traditional static analysis tools towards smarter scanning methods that integrate seamlessly into developer workflows, highlighting the practical application of LLMs as a defense layer against novel attack vectors. Additionally, Datadog plans to expand its security measures to include detection of insecure code markers like personally identifiable information, indicating a broader vision for integrating AI-driven insights into its security posture.

Datadog's new Version History feature for Synthetic Monitoring tests enhances the reliability and efficiency of testing by providing complete visibility into test modifications over time. This feature allows teams to trace failures back to specific changes, restore earlier test versions with ease, and ensure that the right test versions run in appropriate environments, thereby reducing downtime and improving collaboration. With a detailed record of changes, including who made them and when, debugging becomes faster and more effective, as teams can quickly identify whether issues arise from application updates or test edits. The Version History page offers a 30-day log of changes, extendable to 90 days with the Audit Trail feature, and supports the use of Datadog's API or CLI to manage test versions across different environments. By maintaining an auditable record of test runs, teams can ship code confidently, knowing that their testing coverage remains reliable throughout the development lifecycle.

In the realm of Java development, garbage collection (GC) is a crucial process for memory management, designed to automatically reclaim memory that is no longer in use, thereby mitigating risks like memory leaks and dangling pointers associated with manual memory management in languages such as C and C++. Java introduced GC with the managed runtime to enhance developer productivity, though it involves trade-offs like increased runtime overhead and potential non-deterministic pauses, which can be problematic for latency-sensitive applications. Various GC algorithms in OpenJDK, including Serial, Parallel, G1, Shenandoah, and ZGC, cater to different application needs by balancing throughput and latency. Serial GC is suited for environments with limited CPU and memory resources, while Parallel GC maximizes throughput using multiple threads. G1 GC provides a balanced approach with predictable pause times, Shenandoah GC aims for consistent low-latency by operating concurrently with application threads, and ZGC minimizes pause times with a generational mode for enhanced performance. The choice of GC should align with the application's requirements, whether prioritizing throughput in batch processing tasks or low latency in real-time systems, and tools like Datadog can assist in monitoring GC performance effectively.

Datadog enhances its support for OpenTelemetry (OTel) by introducing the Datadog OTLP Metrics API, which facilitates the direct ingestion of OTLP metrics from serverless and third-party SaaS environments into the Datadog platform. This development addresses the need for monitoring in modern cloud-native architectures where traditional collectors cannot be deployed, such as in serverless environments and applications that emit metrics directly in OTLP format. By allowing OTLP metrics to be sent directly to Datadog without requiring a collector or agent, the API expands observability options, enabling comprehensive monitoring of serverless workloads and cloud-provider managed OTel distributions like AWS Distro for OpenTelemetry and Azure Monitor OpenTelemetry Distro. The OTLP Metrics API complements Datadog's existing ingestion methods, including the Datadog Distribution of the OpenTelemetry Collector and other APIs, offering a robust framework for integrating OTLP metrics with existing telemetry data to ensure system health monitoring and issue correlation across diverse environments.

Amazon EKS on Fargate simplifies Kubernetes management by abstracting infrastructure but poses challenges for log collection due to its serverless nature that restricts host-level access. Traditionally, collecting logs from Fargate environments involved using third-party services like Fluent Bit and AWS CloudWatch, which added complexity and cost. Datadog now offers a Kubernetes-native logging method that allows logs to be collected directly by the Datadog Agent, deployed as a sidecar container within application pods. This method bypasses the need for additional infrastructure and configuration, reducing costs and complexity while enhancing log collection with complete Kubernetes metadata for better monitoring. The new approach leverages Datadog's Autodiscovery features to maintain consistent log configurations across environments and provides a more streamlined setup process, allowing users to collect EKS Fargate logs efficiently and with richer contextual information.

In March 2023, Datadog experienced a significant outage due to an unsupervised global update, revealing critical limitations in their systems' ability to handle failures gracefully. The incident underscored the need for a shift from preventing failures entirely to embracing strategies for graceful degradation, ensuring partial functionality even in the face of significant disruptions. Datadog's response involved reevaluating their system designs, focusing on data persistence, prioritizing real-time data processing, and implementing chaos testing to validate improvements. They recognized the importance of avoiding global control systems and reducing technical debt to prevent complex failure modes. By prioritizing the end-user experience and building systems that can adapt and recover quickly, Datadog has reduced the impact and duration of incidents, improving their overall resilience and reliability. This shift has resulted in a noticeable decrease in significant incidents and faster recovery times for their products, reflecting a more robust and customer-focused infrastructure.

Oracle Cloud Infrastructure (OCI) offers robust compute, storage, networking, and database services for both traditional and cloud-native applications, supporting hybrid and multi-cloud environments. Ensuring the security of workloads in OCI involves gaining visibility into activities recorded in OCI Audit Logs, such as authentication attempts and API calls. Datadog Cloud SIEM enhances threat detection by centralizing these logs with security data from an organization's entire stack, utilizing prebuilt detection rules and dashboards to identify suspicious activities. The OCI integration and OCI Content Pack accelerate onboarding and help prioritize threat investigations, providing a unified platform for monitoring and quick response through features like the OCI Security Dashboard. This dashboard offers insights into Oracle Cloud activities, identities, and triggered security signals, allowing analysts to efficiently scope and investigate threats. Datadog's centralized approach empowers security teams to detect and respond to threats across OCI effectively, with options for deeper investigation and correlation of suspicious activities.

Datadog Cloud Cost Management (CCM) now extends its capabilities to Oracle Cloud Infrastructure (OCI), enhancing cost visibility and management for engineering teams operating in hybrid and multi-cloud environments. By integrating OCI into its platform, CCM allows users to monitor daily cost insights alongside observability data from other major cloud providers such as AWS, Microsoft Azure, and Google Cloud, as well as SaaS services like OpenAI and Anthropic. This integration enables organizations to pinpoint cost-saving opportunities, avoid unexpected cost overruns, and manage unpredictable AI expenses more effectively. The platform offers features such as real-time alerts for unusual spending patterns, support for FinOps Cost and Usage Specification (FOCUS) tags, and Datadog Notebooks for collaborative insights into cost optimization. Additionally, CCM's tools for AI cost management, including LLM Observability and GPU Monitoring, provide a comprehensive solution for tracking and optimizing AI-related expenditures. This expansion aims to empower engineering teams with the necessary insights to control costs without compromising application performance, helping them make informed decisions about their infrastructure and services.

Datadog has achieved the Infosec Registered Assessors Program (IRAP) assessment at the PROTECTED level, which is an advanced classification under the Australian Cyber Security Centre framework, to meet the stringent data protection standards required by Australian government agencies and regulated industries moving sensitive workloads to the cloud. This classification applies to Datadog's suite of observability and security products deployed in Australia, ensuring that sensitive data such as healthcare records and public safety operations are securely monitored and hosted within national borders. By doing so, Datadog aligns with government procurement frameworks and regulatory requirements, offering features like audit trails, role-based access control, and customizable retention policies to ensure compliance without compromising performance or visibility. The IRAP PROTECTED assessment, alongside Datadog's local AWS Sydney Region availability zone, supports Australian organizations in adopting cloud services while maintaining infrastructure both on-premises and in the cloud, helping them to monitor, secure, and optimize digital operations.

Datadog relies heavily on email communication for various functions, such as monitor alerts and usage reports, and ensures optimal email performance and deliverability through integrations with Mailgun, SendGrid, and Amazon SES. These integrations utilize webhooks to collect event data, allowing Datadog to monitor the email delivery lifecycle from queuing to successful delivery, including tracking bounces, drops, and deferrals. The organization overcomes inconsistencies in logging terminology by standardizing and enriching log data with Datadog Log Management, creating cohesive insights into email delivery patterns. Custom metrics and Grok Parsers further enhance their visibility and troubleshooting capabilities by analyzing reasons for bounces and ensuring consistent tagging. Datadog's approach includes using Saved Views for efficient troubleshooting and generating custom metrics to achieve granular monitoring of email delivery, thus maintaining the health of their communication channels.

Datadog Workflow Automation, enhanced by Datastore automation rules, allows users to automate processes and reduce the time spent on repetitive tasks by triggering workflows through various signals like alerts, Slack messages, and data changes. Datastore, a schema-less database within Datadog, facilitates the storage and management of custom business or operational data alongside observability data, ensuring that workflows respond instantly to data changes without manual intervention. This integration enables seamless coordination across systems, such as automatically updating incident data from external platforms like GitHub into Datadog for effective incident management. By centralizing data updates, Datastore ensures that all associated workflows remain current, thereby streamlining operations and reducing the need for manual workflow scheduling. The robust automation capabilities of Datadog allow teams to focus on critical tasks by minimizing manual data handling, and users can explore these features further through Datadog's documentation or a 14-day free trial.

Datadog has reached a milestone of offering over 1,000 integrations, which enable customers to collect and analyze data from various technologies they use daily. This extensive ecosystem allows teams to gain comprehensive visibility into their environments by unifying signals from infrastructure, applications, security, and SaaS applications. Datadog's integrations have evolved alongside technological advancements, including cloud services, container platforms, serverless services, and AI workloads, with recent expansions into security and AI to meet growing customer demands and address distributed system risks. The company's investment in R&D supports quick and consistent integration delivery, with a focus on frameworks, tooling, and open standards like OpenTelemetry. Collaboration with partners through the Datadog Partner Network has been essential in developing and scaling integrations, enhancing the platform's capabilities, and ensuring reliability. As multi-cloud adoption and open standards gain traction, Datadog continues to expand its regional availability and support for connecting various data platforms, aiming to streamline workflows and improve operational efficiency for its customers.

Datadog Status Pages, now generally available, is a tool designed to enhance communication during service disruptions by allowing organizations to provide real-time updates through a public or internal web page. Integrated with Datadog Incident Management, it enables teams to publish notices directly from the platform where incidents are managed, reducing context switching and improving communication efficiency. Status Pages allows users to see which services are impacted, their current status, and a timeline of updates, thus minimizing duplicate support tickets and building user trust. Customizable options include mapping the status page to a custom domain, adding company logos, and configuring page visibility, which are particularly useful for SaaS companies to inform users about issues with specific features. Additionally, the tool offers proactive email notifications through subscriptions, ensuring users receive timely updates without repeatedly refreshing the page, while also supporting GDPR compliance through double opt-in functionality. This streamlined communication process helps reduce the workload on support teams and ensures stakeholders are kept informed without diverting focus from resolving the incidents.

Datadog Summit Seoul, scheduled for October 24, 2025, is a key event celebrating the Datadog community, featuring a keynote by Datadog Co-Founder and CTO Alexis Lê-Quôc, who will discuss the latest product updates. The summit will include sessions from companies like Amorepacific and GS Retail, showcasing their use of Datadog and AI to enhance scalability and problem-solving. Afternoon breakouts will highlight customer stories, such as Shinsegae's application architecture modernization, and offer hands-on workshops in Korean. Networking opportunities abound in the expo area, featuring product demos and the AWS GameDay competition. Additionally, an exclusive Partner Day will be held for current and prospective partners to explore growth opportunities and insights into observability, fostering collaboration with Datadog's Partner Network.

Datadog's third-generation event store, Husky, is designed to process over 100 trillion daily events and enable interactive querying at scale by overcoming challenges like varying data schemas and massive data volumes. The architecture comprises a multi-tenant query engine that includes services like the query planner, orchestrator, metadata service, and reader service, which work together to optimize and execute queries efficiently. Husky employs advanced techniques such as fragment pruning, lazy evaluation, multi-layered caching, and shuffle sharding to ensure performance, reduce computational load, and maintain tenant isolation. These strategies allow Husky to handle trillions of queries with sub-second interactivity, scanning a minimal portion of the data. Husky continues to evolve by adopting modularity and interoperability standards like Apache Arrow and Parquet to enhance system adaptability and integration, with plans to further decouple query compute from cache storage to improve efficiency and scalability.

Slurm, an open-source workload management system designed for high-performance computing (HPC) Linux clusters, efficiently schedules jobs and manages resources but can present challenges in job visibility and infrastructure correlation. The Datadog Slurm integration addresses these challenges by collecting metrics from Slurm's central controller, slurmctld, and providing an out-of-the-box dashboard for visualizing job states, resource utilization, and scheduler efficiency. Users can quickly troubleshoot pending or failed jobs by examining job metrics, reasons for job states, and correlating job performance with host-level resource metrics. For Slurm administrators, the integration offers insights into the systemic health of clusters, helping to identify bottlenecks in Slurm components and optimize scheduler parameters. Additionally, Datadog's comprehensive HPC monitoring capabilities extend beyond Slurm, integrating with tools like Nvidia DCGM Exporter and Lustre to provide visibility into GPU, file system, and network components, thereby enhancing the management of HPC environments.