Orchestrating AI Code Review at scale

Code review is essential for identifying bugs and sharing knowledge within engineering teams, but it can often create bottlenecks, with wait times for reviews sometimes extending for hours. To address these challenges, Cloudflare experimented with AI code review tools but found existing solutions lacked the flexibility needed for their large-scale operations. Consequently, they developed a CI-native orchestration system around OpenCode, an open-source coding agent, which employs up to seven specialized AI reviewers to assess various aspects such as security, performance, and compliance. Managed by a coordinator agent, this system consolidates and prioritizes review findings into a single structured comment, enhancing the efficiency of the code review process. The architecture is built on a composable plugin framework that supports diverse version control systems and AI providers, ensuring adaptability and scalability across thousands of repositories. This innovative approach has significantly improved Cloudflare's engineering resiliency, allowing for accurate bug detection and blocking of problematic code, all while maintaining the flexibility to evolve with changing technologies and standards.