Qodo in the NVIDIA GTC Keynote. Here’s Why…
Blog post from Qodo
NVIDIA has launched Nemotron 3 Super, a 120-billion parameter open-source model, to compete with leading proprietary models, using Qodo’s Code Review Benchmark to rigorously evaluate its enterprise readiness. While typical benchmarks like HumanEval or MBPP focus on low-cognitive tasks, Qodo's benchmark tests the model's high-cognitive ability to perform code reviews, assessing its precision and recall in identifying real issues within complex code. Nemotron's 73.4% precision, the highest among open-source models, indicates its effectiveness, though recall lags behind frontier models. Qodo's benchmark, which is transparent and publicly available, highlights the importance of independent verification in AI-generated code, serving as a governance layer that ensures AI output aligns with organizational intent. With code generation increasingly driven by AI, the collaboration between NVIDIA and Qodo underscores the need for separate systems for code writing and reviewing, enhancing reliability in production.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 1 | 6,078 | 960 | 218 | +18% |