How to measure developer experience (DevEx) in the AI era

AI coding assistants have significantly increased PR counts, commit frequency, and lines of code, highlighting the inadequacy of traditional individual output metrics to assess developer productivity. GitClear's analysis of over 200 million lines of code revealed that code churn nearly doubled with widespread AI adoption, underscoring the need to focus on developer experience (DevEx) instead. DevEx, which encompasses systems, workflows, tools, and culture, influences developer productivity and is linked to faster development cycles and lower operational costs. Datadog emphasizes measuring DevEx through feedback loops, cognitive load, and flow state, and has added AI adoption as a fourth dimension to their framework. By tracking system-level and workflow-level metrics alongside developer sentiment surveys, Datadog aims to identify bottlenecks and improve software delivery performance. They employ metrics like process efficiency, tool quality, and cognitive load, and utilize the DORA framework to align DevEx signals with performance outcomes. Datadog's approach includes maintaining up-to-date service catalogs to reduce discovery friction and leveraging AI tools to enhance the operational context for both human and AI collaborators.