Modular and Qualcomm: Same code, new silicon

Modular announced that Qualcomm Technologies’ data center AI accelerators, beginning with the Cloud AI 100 and extending to the Dragonfly AI 200 and future chips, are being integrated into its MAX and Mojo software platform, allowing developers to target Qualcomm NPUs with the same model code and tooling used for NVIDIA and AMD GPUs. The collaboration brought the Cloud AI 100 Ultra online through a native LLVM Hexagon-based backend rather than an adapter layer, accommodating its SIMD-oriented execution model, explicit DMA-managed memory, vector and matrix engines, and multi-chip architecture. After initially enabling optimized kernels and an end-to-end GPT-2 pipeline, the teams reportedly progressed to serving the Gemma 4 31B model across four devices in under six months, with support for tensor parallelism, paged attention, speculative decoding, and a mixture-of-experts variant. Modular says the work demonstrates its portability-by-design approach, in which shared compiler, runtime, graph, model, and serving components reduce the effort required to support new hardware, while ongoing work aims to optimize communications, extend model support, and complete integration for the newer Dragonfly AI 200 platform.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.