Home / Companies / Qodo / Blog / Post Details
Content Deep Dive

Qodo in the NVIDIA GTC Keynote. Here’s Why…

Blog post from Qodo

Post Details
Company
Date Published
Author
Itamar Friedman
Word Count
1,205
Company Posts That Month
14
Language
English
Hacker News Points
-
Summary

NVIDIA has launched Nemotron 3 Super, a 120-billion parameter open-source model, to compete with leading proprietary models, using Qodo’s Code Review Benchmark to rigorously evaluate its enterprise readiness. While typical benchmarks like HumanEval or MBPP focus on low-cognitive tasks, Qodo's benchmark tests the model's high-cognitive ability to perform code reviews, assessing its precision and recall in identifying real issues within complex code. Nemotron's 73.4% precision, the highest among open-source models, indicates its effectiveness, though recall lags behind frontier models. Qodo's benchmark, which is transparent and publicly available, highlights the importance of independent verification in AI-generated code, serving as a governance layer that ensures AI output aligns with organizational intent. With code generation increasingly driven by AI, the collaboration between NVIDIA and Qodo underscores the need for separate systems for code writing and reviewing, enhancing reliability in production.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 1 6,078 960 218 +18%