Understanding AI's Impact on Developer Workflows | The Research Blog
Blog post from JetBrains
AI coding assistants are increasingly integrated into developers' daily workflows, offering perceived benefits in productivity and efficiency, yet their long-term impact remains complex and nuanced. A study by the Human-AI Experience team analyzed two years of telemetry data from 800 developers using JetBrains IDEs, complemented by surveys and interviews, to explore how AI tools reshape workflows over time. The findings reveal a discrepancy between developers' perceptions and their actual behaviors, as telemetry data showed sustained increases in code production, editing, and context switching among AI users, despite developers often perceiving minimal change. While AI tools appear to enhance code reuse and productivity, their impact on code quality is less clear, with developers continuing to double-check AI-generated code. The study underscores the importance of mixed-method approaches to capture the subtle shifts in workflows that AI introduces, offering a deeper understanding of how these tools influence everyday development practices beyond initial impressions.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Coding Assistant | 9 | 1,480 | 382 | 153 | +18% |
| Developer Experience | 1 | 611 | 275 | 100 | +27% |
| LLM | 1 | 5,932 | 1,046 | 223 | -2% |
| Observability | 1 | 4,496 | 812 | 176 | +40% |