May 2024 Summaries

Kong has released Kong Gateway 3.7 and Kong Gateway Enterprise 3.7, which include new capabilities in the Kong AI Gateway aimed at facilitating the development and management of AI applications. These updates promote the Kong AI Gateway to GA status, enabling AI developers to focus on building AI-specific use cases like chatbots and integrations without needing to establish their own infrastructure. Notable features include support for the OpenAI SDK, AI streaming in the "ai-proxy" plugin for real-time responses, and new enterprise plugins for rate-limiting AI token usage and integrating Azure Content Safety to filter harmful content. Additionally, it now supports dynamic URL-sourced LLM models and the Anthropic Claude 2.1 Messages API, while updating its analytics logging format to better measure AI request consumption. These enhancements aim to accelerate AI application deployment by offering a unified API interface for various LLMs and ensuring content safety and cost management.

Kong Gateway 3.7 and Kong Gateway Enterprise 3.7 bring a host of new features and enhancements, including the general availability of the edge AI Gateway, a new context propagation module, and improved security measures for highly regulated environments. The AI Gateway, now production-ready, offers capabilities like centralized AI API keys and AI streaming support, while the context propagation module provides fine control over tracing headers for distributed systems. Performance enhancements are achieved through a new cache key generation algorithm and a migration path for transitioning from JSON to expression-based routing, offering efficiency gains. Security improvements include the use of JWTs for authorization requests and responses, bolstering protection against potential interception and manipulation. Additionally, the release introduces OAuth 2.0 Demonstrating Proof-of-Possession for enhanced token security, making the update a significant boost to security, efficiency, and compliance for enterprises.

Kong Insomnia 9.2 has been officially released, building upon the features of Insomnia 9.0 with enhancements such as support for automatically generating fake values using the Faker.js library, which allows users to insert randomized data across more than 100 formats into their collections. This update also includes significant performance improvements, allowing the application to handle large OpenAPI specifications without disruptions and enhancing global search capabilities across multiple organizations. The release continues to focus on offline usability and plans to expand its testing capabilities by integrating tests directly into collections to facilitate easier transitions from other API clients. Users can start using these new features for free with Insomnia 9.2.

The service mesh architecture pattern has become essential for microservices-based projects and emphasizes the importance of controlling all application components, including databases and event processing services. It focuses on managing east-west traffic within the application, applying multiple policies related to security, traffic control, and observability, while also addressing north-south ingress traffic for external consumption, which involves authentication and metrics management. The blog post discusses a reference architecture using Red Hat OpenShift Container Platform (OCP) and technologies like Istio Service Mesh and Kong Ingress Controller, highlighting the capabilities of Red Hat OCP in deploying applications and service meshes across hybrid clouds. The architecture integrates Kong's technologies, Konnect, and KIC, to build modern applications, with Red Hat OpenShift Service Mesh providing functions like monitoring and load balancing, while Kong Ingress Controller enforces policies like authentication and traffic monitoring. Additional layers include Keycloak for OIDC-based authentication and Kiali for monitoring and management, leveraging Prometheus and Grafana for visualization and analytics.

Kong Konnect has introduced a comprehensive search bar designed to enhance user experience by allowing fast and precise retrieval of information across various entities within the platform. This feature, powered by a platform search API, supports advanced query syntax and caters to diverse search needs, covering 29 entities with the ability to search by attributes and labels. The search results are organized by relevance and provide a summary of attributes and their relationships, facilitating easier navigation and management, especially for users with numerous entities. The search API ensures security by only displaying entities the user has permission to access and offers global and regional access to improve response times and data residency compliance. Users can utilize basic keyword searches or employ advanced syntax for more specific queries, enhancing productivity by reducing time spent searching and allowing more time for actionable tasks.

The text explores the evolution of data integration from legacy systems to cloud-native architectures, highlighting the limitations of traditional systems characterized by data silos and the challenges they pose for integration and innovation. It discusses the shift towards decentralized architectures using federated APIs and microservices, which facilitate easier data sharing and cross-functional collaboration while improving scalability and innovation. However, this shift brings security concerns due to the increased attack surface, necessitating robust identity verification, access management, and data protection. API gateways are presented as effective solutions to these challenges, offering capabilities like authentication, access control, monitoring, and policy enforcement to ensure secure and efficient API management. The text emphasizes that API gateways support the transition to federated architectures by mitigating risks associated with decentralization, ultimately enhancing organizational agility and performance in the digital landscape.