MiniMax-01 is Now Open-Source: Scaling Lightning Attention for the AI Agent Era

MiniMax has open-sourced its new MiniMax-01 series, which includes the MiniMax-Text-01 and MiniMax-VL-01 models, introducing a pioneering Lightning Attention mechanism that offers an alternative to traditional Transformer architectures. This innovation allows the models to handle context lengths up to 4 million tokens, significantly surpassing existing models in capacity while maintaining high performance and efficiency. The architectural advancements, including efficient training and inference optimizations, enable MiniMax to provide competitive pricing for their API services. The open-sourcing of these models aims to inspire further research and accelerate the development of AI Agents, highlighting the models' robust performance on both academic benchmarks and real-world data. MiniMax encourages community interaction and collaboration through various platforms and is committed to ongoing updates and improvements to these models.