Kong AI Gateway Goes GA, New Capabilities Added
Blog post from Kong
Kong has released Kong Gateway 3.7 and Kong Gateway Enterprise 3.7, which include new capabilities in the Kong AI Gateway aimed at facilitating the development and management of AI applications. These updates promote the Kong AI Gateway to GA status, enabling AI developers to focus on building AI-specific use cases like chatbots and integrations without needing to establish their own infrastructure. Notable features include support for the OpenAI SDK, AI streaming in the "ai-proxy" plugin for real-time responses, and new enterprise plugins for rate-limiting AI token usage and integrating Azure Content Safety to filter harmful content. Additionally, it now supports dynamic URL-sourced LLM models and the Anthropic Claude 2.1 Messages API, while updating its analytics logging format to better measure AI request consumption. These enhancements aim to accelerate AI application deployment by offering a unified API interface for various LLMs and ensuring content safety and cost management.
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.