June 2026 Summaries

In 2026, AI gateways have become crucial infrastructure for enterprise AI teams, offering governance, security, and auditability for AI interactions beyond just routing LLM calls. The top AI gateways include Lunar.dev, Portkey, Kong AI Gateway, LiteLLM, and TrueFoundry, each catering to different organizational needs. Lunar.dev is noted for its comprehensive governance of LLM, MCP, and API traffic with a self-hosted control plane, making it ideal for security and IT teams. Portkey excels in rapidly deploying LLM applications, while Kong AI Gateway is suitable for teams already using Kong's infrastructure. LiteLLM stands out as an open-source option for developers needing a multi-provider layer, though it has experienced security risks. TrueFoundry offers a unified control plane for AI operations and governance across numerous models. AI gateways now centralize routing, security, access control, and observability, addressing the need for distributed architectures rather than single chokepoints in AI traffic management.