Works on my machine: how we use AI to reproduce reported bugs

Sentry's SDK teams manage a diverse range of open-source SDKs across different languages and frameworks, dealing with numerous bug reports and issues. To streamline the bug reproduction and triage process, they have developed a Claude skill that leverages large language models (LLMs) to automate tedious setup tasks, such as creating boilerplate applications needed for reproducing bugs. This tool parses details from GitHub issues, gathers relevant metadata, and attempts to create minimal reproductions using standard tooling, providing clear instructions for running these reproductions. Although full automation of this process is considered for the future, the team remains cautious about potential bot noise, emphasizing the need for a balanced approach where human oversight is maintained.