1-Bit Models Just Moved the Pareto Frontier

PrismML has unveiled the Bonsai family of 1-bit language models, offering a notable advancement in AI/ML technology by significantly reducing model size while maintaining competitive performance. The Bonsai 8-billion-parameter model, weighing only 1.15 GB, achieves an impressive 14.2x compression ratio over FP16 models and generates tokens 8x faster, making it possible to run on edge hardware that previously couldn't accommodate such models. Unlike past binary-weight neural networks that struggled with issues like brittleness and deployment friction, Bonsai employs a mathematically grounded compression framework that ensures stable model behavior. Evaluations against 11 models in its range show that Bonsai performs well across multiple benchmarks, such as knowledge, reasoning, and tool calling, outperforming models much larger in size while using significantly less energy. This breakthrough allows advanced models to operate on constrained devices, altering system design and deployment strategies fundamentally, with PrismML's approach being architecture-agnostic and open for unrestricted commercial use under Apache 2.0.