Company
Date Published
Author
Marco Palladino
Word count
968
Language
English
Hacker News points
None

Summary

Kong has released Kong Gateway 3.7 and Kong Gateway Enterprise 3.7, which include new capabilities in the Kong AI Gateway aimed at facilitating the development and management of AI applications. These updates promote the Kong AI Gateway to GA status, enabling AI developers to focus on building AI-specific use cases like chatbots and integrations without needing to establish their own infrastructure. Notable features include support for the OpenAI SDK, AI streaming in the "ai-proxy" plugin for real-time responses, and new enterprise plugins for rate-limiting AI token usage and integrating Azure Content Safety to filter harmful content. Additionally, it now supports dynamic URL-sourced LLM models and the Anthropic Claude 2.1 Messages API, while updating its analytics logging format to better measure AI request consumption. These enhancements aim to accelerate AI application deployment by offering a unified API interface for various LLMs and ensuring content safety and cost management.