Four copies of a cheap model beat Fable at 1/7 the price

TrustedRouter reports that synthesizing multiple independent runs of the low-cost open model MiniMax-M3 improved performance on the 100-task DRACO deep-research benchmark, with four runs reaching 68.1 versus 66.2 for a single run and outperforming Fable 5’s reported solo score of 65.3 at an estimated fraction of its cost. Performance rose toward roughly 69 with seven to ten M3 runs but plateaued below a five-model all-open panel at 69.2 and a mixed frontier panel at 73.4, suggesting that model diversity provides benefits that repeated copies cannot fully replicate. The results indicate that synthesis is most effective when separate runs make different errors: two M3 runs showed no gain because they tended to fail similarly, while two Opus 4.8 runs improved substantially because their mistakes were more complementary. Increasing sampling temperature did not improve outcomes, whereas additional genuinely independent runs did. The reported costs were about $37 per 100 tasks for four M3 runs plus synthesis and $87 for ten runs, compared with a modeled approximately $250 for one Fable 5 run, though the latter estimate relies on assumptions about unpublished pricing and token use.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.