Data-center AI, now on a laptop — POCKET-Darwin-180B

VIDRAFT’s FINAL-Bench project released POCKET-Darwin-180B, a 4-bit GGUF version of the 180-billion-parameter Darwin-180B-RSI mixture-of-experts model, reducing its size from 360 GB to 111 GB while claiming to preserve its 87.65% accuracy on a 2,000-question MMLU-Pro evaluation. The model can run on systems ranging from an 8 GB VRAM laptop with 32 GB RAM, where selected experts are streamed from SSD, to CPU-only servers or 128 GB-memory mini PCs where more weights can remain resident. Its feasibility is attributed to the MoE architecture, which activates roughly 3 billion parameters per token, llama.cpp memory mapping, and a “graft quantization” approach that retains most of an existing quantized base model while replacing 300 tensors altered by self-improvement training. The underlying Darwin model is based on Alibaba’s Qwen3.8-Flash-Next and was trained through recursive self-improvement using only automatically verified model-generated solutions, with its developers reporting strong leaderboard results across reasoning, knowledge, vision, and law benchmarks. The release is presented as useful for organizations requiring local, offline inference for sensitive workloads, and it is available through Hugging Face and ModelScope under the Qwen Community License.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.