How we built Datadog Experiments

Datadog rebuilt Eppo’s experimentation product as Datadog Experiments, integrating A/B test analysis with warehouse data, Real User Monitoring, Product Analytics, and observability signals to help teams make release decisions more quickly. The platform extends CUPED variance reduction to audience segments and percentile metrics such as p90 page-load time, enabling more statistically efficient results and earlier detection of performance regressions. It also redefines global lift as the transparent product of local lift and coverage, including for windowed metrics, making estimated company-wide impact easier to interpret and verify. For warehouse-native metrics, a Copy SQL feature provides the underlying query used for reported results, while diagnostic checks flag issues such as traffic imbalances or missing data. Near-real-time behavioral and performance metrics from RUM, Product Analytics, APM spans, and Session Replay provide early signals before slower warehouse metrics arrive, complementing longer-term business measures such as revenue and retention.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.