Home / Companies / Hugging Face / Blog / Post Details
Content Deep Dive

Run fast, private agents on-device with LFM2.5-24B-A2B

Blog post from Hugging Face

Post Details
Company
Date Published
Author
Raahul Vignesh, Song Duong, Akhilesh Deepak Gotmare, Fernando Fernandes Neto, Jiahui Wang, Mayank Agarwal, nathan ranchin, Sergei Tilga, Sinoué GAD, Tim Seyde, Zetian Li, changyi yang, Simon Lee, Leonie Monigatti, Maxime Labonne, Karthik Macherla, Alfred
Word Count
1,226
Company Posts That Month
38
Language
-
Hacker News Points
-
Post removed?
No
Summary

Liquid AI introduced LFM2.5-24B-A2B, an open-weight mixture-of-experts reasoning model designed for private, fast on-device agents, with 24 billion total parameters but only 2 billion active per token. Built on LFM2-24B-A2B, it expands context capacity to 131,000 tokens, doubles its vocabulary to improve non-Latin language support, and uses explicit reasoning, tool calls, and multi-step agent training across supervised fine-tuning, distillation, and reinforcement learning. In evaluations against similarly sized models, it performed particularly strongly in tool use, agentic workflows, and instruction following, including a 48.09 score on LiveClaw and a leading AutomationBench result, while larger models retained advantages in knowledge-intensive and some coding benchmarks. Liquid AI reports inference speeds of 184 tokens per second on an Apple M5 Max, 114 on a Ryzen AI Max+ 395, and more than 21,000 output tokens per second at high concurrency on an NVIDIA B300 GPU. The model supports major inference frameworks including llama.cpp, MLX, vLLM, SGLang, and ONNX, can be integrated with local agent harnesses such as Hermes Agent, OpenClaw, Pi, and OpenCode, and is available alongside its base version on Hugging Face.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
OpenClaw 3 54 14 13 -57%
AI Model Fine-tuning 2 301 87 38 -59%
MLX 2 3 2 2 -96%
Local AI 1 105 33 12 -51%
Reinforcement learning 1 62 37 18 -61%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.