MAX 24.4 - Introducing quantization APIs and MAX on macOS

MAX 24.4 introduces a new quantization API for MAX Graphs and expands its availability to macOS, allowing developers to build and deploy Generative AI pipelines with improved performance across local and cloud environments. The Quantization API significantly reduces latency and memory usage, enhancing the efficiency of AI models by offering support for BF16, INT4, and INT6 quantization, and demonstrating up to 8x performance improvements on desktop and cloud architectures. The release also showcases new implementations of Llama 2 and Llama 3 models, which utilize the quantization API to offer state-of-the-art performance across various CPU types. Alongside these technical advancements, the update includes enhancements to the Mojo language and a comprehensive overhaul of the documentation to assist developers in navigating the MAX platform. The release is supported by community contributions that include significant performance and quality improvements.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.