Home / Companies / Hugging Face / Blog / Post Details
Content Deep Dive

DAVIDAU DELETED MY POST AND BANNED ME FOR ASKING ABOUT BENCHMARKS — HERE IS THE FULL ANALYSIS (9B + 27B + 390 MODELS)

Blog post from Hugging Face

Post Details
Company
Date Published
Author
DedeProGames
Word Count
2,594
Company Posts That Month
52
Language
-
Hacker News Points
-
Post removed?
No
Summary

A community post alleges that model publisher DavidAU deleted a request for modern benchmark results and blocked the author from interacting with more than 390 model repositories, presenting this as part of a broader pattern involving ignored, closed, or removed critical discussions. The author examines DavidAU’s 9B and 27B Qwen fine-tunes, arguing that their prominent performance claims rely on seven older benchmarks from 2018–2019, particularly ARC-C, rather than contemporary evaluations such as SWE-bench Verified, Terminal-Bench, GPQA Diamond, LiveCodeBench, AIME, and agentic tool-use tests. Citing research that questions ARC-C’s evaluation setup and comparing the fine-tunes’ reporting with the base Qwen models’ extensive published evaluations, the post contends that the available scores cannot establish claims of frontier-level intelligence or reveal whether fine-tuning preserved coding, reasoning, instruction-following, and tool-use abilities. It also raises concerns about undocumented custom GGUF quantization methods, use of older quant formats, flash-attention issues, promotional model naming and README content, and a lack of reproducible evaluation configurations or perplexity measurements. While stating that the models may still be good, the author calls for transparent modern benchmark results, documented methodology, quantization-quality comparisons, explanations for technical choices, and open discussion without moderation actions against users who request evidence.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
AI Model Fine-tuning 2 278 80 43 -70%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.