63 earnings calls. 0 engineering outcomes tied to AI.

An analysis of 63 recent company earnings calls revealed that while many companies, such as HubSpot, Google, and Spotify, report high percentages of AI-generated code, none have tied these figures to concrete engineering outcomes like deployment frequency or incident resolution times. Despite widespread AI adoption in coding, with reports of increased individual productivity, organizations have not seen a corresponding increase in overall delivery velocity due to bottlenecks in code reviewing and integration processes. Companies like Pfizer and Amazon were able to connect AI usage to significant outcomes by having clear metrics for comparison, but for engineering, isolating AI's impact remains challenging due to the variability in project scopes and complexities. The report suggests that to truly demonstrate the value of AI in engineering, companies need to establish baseline metrics and clearly connect AI adoption to specific engineering improvements.