Content Deep Dive

Can we trust LLMs to judge whether a research idea is novel?

Blog post from Hugging Face

Post Details
Company
Date Published
Author
Kyle Wiggers
Word Count
1,767
Company Posts That Month
99
Language
-
Hacker News Points
-
Post removed?
No
Summary

Ai2’s “Old Ideas, Novel Problems” study finds that large language models are currently unreliable judges of whether scientific research ideas are genuinely novel, particularly when assessing AI-generated proposals. Using a benchmark derived from ICLR 2026 peer-review comments, the researchers assembled pools of highly novel and lower-novelty human-authored ideas, then compared human ideas with ideas generated by a basic LLM system. Across six models, small changes in prompts, formatting, reasoning budgets, retrieval methods, and voting procedures often produced sharply different novelty verdicts; in one case, a prompt change shifted GPT-5.4’s accuracy from 93.5% to 40.9% on human-versus-generated comparisons. Additional search, larger reasoning budgets, and specialized novelty-evaluation systems did not reliably improve performance, with a simple Claude Opus 4.6 prompt outperforming more expensive purpose-built tools in one test. The researchers conclude that novelty judges should be evaluated on the kinds of ideas they will actually assess, tested for sensitivity to prompts and model choices, and supported by evolving benchmarks and improved literature-grounding methods.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 7 6,578 1,243 236 +9%
Data Pipeline 1 406 164 73 +49%
Vector Search 1 1,978 415 135 +18%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.