Introducing Kong AI Gateway 2.2: What's New
Blog post from Kong
Kong AI Gateway 2.2 is presented as an update designed to help enterprises govern a rapidly diversifying AI ecosystem without tying their infrastructure to a single model, provider, or interface. It adds native support for TypeSafe JEV, which returns structured probabilistic decisions that can support uses such as model-routing choices, and introduces Skills API support that translates between a common Kong representation and provider-specific implementations. A new passthrough mode allows custom, self-hosted, preview, and non-LLM AI endpoints, including vLLM, Ollama, and NVIDIA NIM, to operate behind the gateway without request-body transformation while retaining authentication, rate limiting, and logging. The release also supports custom plugins for organization-specific policies, expands advanced rate limiting with credential-based matching, and offers a technical-preview integration with Headroom for prompt compression to reduce token use, cost, and potentially latency while tracking compression metrics and preserving fallback behavior. Overall, the update emphasizes “strategic portability,” aiming to give developers flexibility in choosing AI technologies while providing platform teams a consistent layer for security, governance, consumption controls, extensibility, and operational visibility.
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.