Capacitor Showcase – LocalLLM

Capacitor is a versatile tool enabling developers to create advanced mobile applications with native hardware functionality and local-first data, traditionally built with web technologies. The Capacitor Team is exploring the complexities of creating apps involving rich media, background processing, and AI, documenting challenges and solutions throughout the process. Their first showcase is Oakline Bank, a fictional mobile banking app developed to demonstrate how a single cross-platform codebase can produce a modern banking experience on both iOS and Android. The app features OakBot, an AI-powered assistant that uses on-device AI to maintain user privacy by processing financial data locally instead of sending it to cloud servers. Capacitor LocalLLM, a plugin facilitating on-device AI, supports this functionality by allowing models to access specific user data through context injection, optimizing natural language processing over JSON for efficiency. This approach highlights the potential of small on-device AI models to enhance mobile applications while maintaining user privacy.