The safest AI models trust you the least

PrometheusBench is an open-source benchmark created to measure how often language models answer rather than refuse 30 short prompts spanning biology, cybersecurity, and questions about language models, with its author arguing that broad refusals can prevent ordinary users from obtaining legitimate information, such as explanations of their own genetic data. In the reported results, GLM-5.1 answered 29 of 30 prompts, Kimi K2.6 answered 27, DeepSeek V4 Flash answered 26, Claude Haiku 4.5 answered nine, Claude Opus 4.8 answered one, and Claude Opus 4.7 answered none. The author contends that safety-focused refusals create limited barriers for malicious actors who can switch models or use open-weight systems, while disproportionately affecting users asking openly and in good faith. A further test using TrustedRouter’s Synth feature, which queried multiple models and returned the first non-refusal response, produced answers for all 30 prompts, supporting the author’s argument that refusals may be easily bypassed in multi-model environments.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.