Can we trust LLMs to judge whether a research idea is novel?
Blog post from Hugging Face
Ai2’s “Old Ideas, Novel Problems” study finds that large language models are currently unreliable judges of whether scientific research ideas are genuinely novel, particularly when assessing AI-generated proposals. Using a benchmark derived from ICLR 2026 peer-review comments, the researchers assembled pools of highly novel and lower-novelty human-authored ideas, then compared human ideas with ideas generated by a basic LLM system. Across six models, small changes in prompts, formatting, reasoning budgets, retrieval methods, and voting procedures often produced sharply different novelty verdicts; in one case, a prompt change shifted GPT-5.4’s accuracy from 93.5% to 40.9% on human-versus-generated comparisons. Additional search, larger reasoning budgets, and specialized novelty-evaluation systems did not reliably improve performance, with a simple Claude Opus 4.6 prompt outperforming more expensive purpose-built tools in one test. The researchers conclude that novelty judges should be evaluated on the kinds of ideas they will actually assess, tested for sensitivity to prompts and model choices, and supported by evolving benchmarks and improved literature-grounding methods.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 7 | 6,578 | 1,243 | 236 | +9% |
| Data Pipeline | 1 | 406 | 164 | 73 | +49% |
| Vector Search | 1 | 1,978 | 415 | 135 | +18% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.