Kong's AI Manager: Govern & Observe Agentic Traffic to Thousands of LLMs

Kong has announced the general availability of AI Manager within Kong Konnect, a platform designed to manage API, AI, and event connectivity across digital applications and AI agents. The new AI Manager capabilities allow users to expose, govern, secure, and observe large language model (LLM) traffic using a user-friendly interface. These features complement existing API and declarative configurations, enabling comprehensive management of LLM and MCP traffic via Kong’s AI Gateway technology. AI Manager provides tools to manage AI policies, curate LLM catalogs, visualize agentic maps, and observe LLM analytics, offering insights into token, cost, and request consumption. It supports both hybrid AI Gateway deployments and managed Dedicated Cloud Gateways, with native Kubernetes support through the Ingress Controller or Operator. Users can also access over 50 specialized AI capabilities, including federated governance and PII sanitization, enhancing the ease of managing AI infrastructure across major cloud platforms.