Announcing Kong’s New Open Source AI Gateway

Kong has launched six new open-source AI plugins in Kong Gateway 3.6, transforming every Kong Gateway deployment into an AI Gateway, enabling developers to integrate multiple large language models (LLMs) into their products more efficiently. The plugins include AI Proxy, AI Request/Response Transformer, AI Prompt Guard, AI Prompt Template, and AI Prompt Decorator, each designed to enhance AI and LLM usage by providing functionalities like multi-LLM integration, centralized AI credential management, L7 AI metrics collection, no-code AI integrations, advanced prompt engineering, and AI prompt firewall capabilities. Built atop Kong Gateway, these plugins offer high performance and low latency, essential for AI applications, while allowing orchestration of AI flows in cloud or self-hosted environments. They also leverage over 1,000 existing plugins for added features such as authentication, rate-limiting, and traffic control, making Kong's AI Gateway the most capable in the ecosystem. The plugins are supported by Kong's cloud platform, Kong Konnect, and Kong Gateway Enterprise, and users can get started with these new capabilities through demonstration videos and guides available from Kong.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.