Kimi K3 by Moonshot now available on Modal
Blog post from Modal
Moonshot has launched Kimi K3, a groundbreaking 2.8 trillion parameter multimodal model designed for extensive token context windows and native vision capabilities. With strategic partnerships with Modal and vLLM, K3 is available on day one with token-based pricing and an Auto Endpoint option for dedicated capacity. Kimi K3 employs a mixture-of-experts transformer architecture, enabling efficient scaling with active experts per token and a 1 million token context window. Its innovative features, such as Kimi Delta Attention and Attention Residuals, provide 2.5 times the scaling efficiency of its predecessor, K2. Moonshot's efforts in quantization-aware training and expert parallelism optimization ensure the model runs across diverse hardware platforms. Modal enhances K3's performance with a custom DFlash speculator, significantly speeding up decode time and boosting throughput on agentic tasks. Available through Modal's platform with a $30 monthly compute credit, Kimi K3 is poised to redefine open AI model capabilities with its impressive performance metrics and accessibility.
No tracked trend matches for this post yet.
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.