DAVIDAU DELETED MY POST AND BANNED ME FOR ASKING ABOUT BENCHMARKS — HERE IS THE FULL ANALYSIS (9B + 27B + 390 MODELS)
Blog post from Hugging Face
A community post alleges that model publisher DavidAU deleted a request for modern benchmark results and blocked the author from interacting with more than 390 model repositories, presenting this as part of a broader pattern involving ignored, closed, or removed critical discussions. The author examines DavidAU’s 9B and 27B Qwen fine-tunes, arguing that their prominent performance claims rely on seven older benchmarks from 2018–2019, particularly ARC-C, rather than contemporary evaluations such as SWE-bench Verified, Terminal-Bench, GPQA Diamond, LiveCodeBench, AIME, and agentic tool-use tests. Citing research that questions ARC-C’s evaluation setup and comparing the fine-tunes’ reporting with the base Qwen models’ extensive published evaluations, the post contends that the available scores cannot establish claims of frontier-level intelligence or reveal whether fine-tuning preserved coding, reasoning, instruction-following, and tool-use abilities. It also raises concerns about undocumented custom GGUF quantization methods, use of older quant formats, flash-attention issues, promotional model naming and README content, and a lack of reproducible evaluation configurations or perplexity measurements. While stating that the models may still be good, the author calls for transparent modern benchmark results, documented methodology, quantization-quality comparisons, explanations for technical choices, and open discussion without moderation actions against users who request evidence.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| AI Model Fine-tuning | 2 | 278 | 80 | 43 | -70% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.