MediaTek NPU and LiteRT: Powering the next generation of on-device AI

The Neural Processing Unit (NPU) is essential for enabling next-generation on-device AI by delivering high performance with low power consumption, allowing devices like smartphones and tablets to run complex AI models. The deployment of AI on NPUs has been challenging due to diverse SoC variants and the lack of integration with existing ML infrastructure, leading to complex workflows. To address these issues, MediaTek and Google have introduced the LiteRT NeuroPilot Accelerator, which simplifies the deployment of AI models on MediaTek NPUs through a unified API and supports both offline and online compilation workflows. This accelerator enhances generative AI capabilities, offering optimized support for models like Google’s Gemma family, which are designed for on-device use cases and deliver significantly faster inference speeds. The new API supports efficient, cross-platform development by allowing zero-copy data transfer between hardware buffers, crucial for real-time applications. The LiteRT NeuroPilot Accelerator is now available, significantly improving the user experience on millions of MediaTek devices globally.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.