Home / Companies / Modal / Blog / Post Details
Content Deep Dive

Kimi K3 by Moonshot now available on Modal

Blog post from Modal

Post Details
Company
Date Published
Author
-
Word Count
558
Company Posts That Month
2
Language
English
Hacker News Points
-
Post removed?
No
Summary

Moonshot has launched Kimi K3, a groundbreaking 2.8 trillion parameter multimodal model designed for extensive token context windows and native vision capabilities. With strategic partnerships with Modal and vLLM, K3 is available on day one with token-based pricing and an Auto Endpoint option for dedicated capacity. Kimi K3 employs a mixture-of-experts transformer architecture, enabling efficient scaling with active experts per token and a 1 million token context window. Its innovative features, such as Kimi Delta Attention and Attention Residuals, provide 2.5 times the scaling efficiency of its predecessor, K2. Moonshot's efforts in quantization-aware training and expert parallelism optimization ensure the model runs across diverse hardware platforms. Modal enhances K3's performance with a custom DFlash speculator, significantly speeding up decode time and boosting throughput on agentic tasks. Available through Modal's platform with a $30 monthly compute credit, Kimi K3 is poised to redefine open AI model capabilities with its impressive performance metrics and accessibility.

Trends Found in this Post

No tracked trend matches for this post yet.

Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.