Enabling more private generative AI

Generative AI (gen AI) holds significant potential for creating products that require stringent privacy and confidentiality measures, such as personal assistants and business automation tools. Google has developed technologies like the GenC open-source project, which combines Confidential Computing, Gemma open-source models, and mobile platforms to experiment with gen AI applications handling sensitive data. One example is a mobile app using a hybrid setup of two large language models (LLMs), Gemma 2B on-device for swift, local processing, and the more robust Gemma 7B in Google Cloud's Confidential Space for complex queries, offering a balance of speed, cost-efficiency, and quality. This architecture prioritizes privacy through encrypted communication and verification processes, while also allowing developers to utilize a flexible, language-independent Intermediate Representation (IR) for seamless deployment across various platforms. GenC is designed to simplify the development process and encourage experimentation, with ongoing enhancements expected to improve performance and broaden the range of supported models and hardware.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.