October 2024 Summaries

Goldman Sachs, a prominent player in the investment banking sector, emphasizes the strategic importance of engineering and APIs in its operations, with engineering comprising a significant portion of its workforce. At the API Summit 2024, Rohan Deshpande, Managing Director at Goldman Sachs, highlighted how APIs are integral to the firm's client-focused approach, enhancing efficiency and enabling innovation. APIs serve as a crucial abstraction layer, allowing different teams to work independently while maintaining compliance with stringent regulatory standards. Deshpande noted that Goldman Sachs leverages Kong’s platform to streamline API management, ensuring security, compliance, and efficient service delivery. The firm’s API-first strategy supports both client-facing and internal applications, facilitating transaction banking and developer productivity. As AI and GenAI gain traction, APIs are poised to play an even more critical role, providing essential abstraction and control over AI models, thus aligning with Goldman Sachs' commitment to innovation and client service excellence.

Kong has introduced a new gateway deployment method, Serverless Gateways, in its Kong Konnect platform, allowing Konnect Plus users to deploy a fully managed gateway quickly and affordably. This serverless option is designed for rapid prototyping, testing, and experimentation without the financial and operational burdens typical of traditional gateways. The flexibility of deployment options, which also include Dedicated Cloud and Hybrid modes, caters to diverse organizational needs. Dedicated Cloud Gateways offer high performance and security akin to visiting a high-end café, while Hybrid Gateways provide deployment flexibility similar to a home coffee setup. Serverless Gateways, comparable to grabbing a quick coffee from a convenience store, are ideal for non-production environments where speed and cost-effectiveness are prioritized. This new offering aims to streamline API management, enabling developer teams to focus on core application development by providing a fast and efficient gateway setup.

Michaels, an arts and crafts retailer, has been at the forefront of integrating advanced API management to enhance their technology infrastructure, using Kong Gateway and Kong Konnect to streamline operations across their extensive network of stores in the US and Canada. Executive Vice President and CIO Uma Bhemisetty highlights the critical role of a unified API platform in managing the retailer's complex system of internally built and acquired technologies, which is essential for maintaining seamless in-store and online customer experiences, especially during peak seasons like Black Friday. The transition from open source to Kong Konnect was driven by the need for advanced management features, centralized policy management, and robust support, ensuring system reliability and scalability during high-demand periods. This strategic move has not only improved developer productivity by alleviating the burden of managing numerous API endpoints but also enhanced the ability to monitor and analyze API performance, which is crucial for adapting to evolving customer expectations and technological advancements. Bhemisetty emphasizes the importance of preparation and collaboration with Kong to ensure that Michaels remains a leader in API excellence, ready to meet future challenges and opportunities in the retail sector.

API product tiering is a strategic approach to offering varied levels of API access, features, and usage limits based on customer subscription plans, which facilitates monetization and efficient resource management. Kong Konnect, a cloud-native API lifecycle management platform, supports this model by enabling organizations to define API products, set authentication protocols, and manage consumer access through consumer groups. By implementing different tiers, such as free, basic, and premium, companies can tailor API access and rate limits to different user needs, as demonstrated by a fictional financial services company offering market data, account information, and payment processing APIs. This approach not only allows for the efficient scaling of services but also enhances user experience and unlocks new revenue streams across various industries.

APIs are crucial for modern applications, but managing their access and security policies can be challenging, especially when flexible, scalable, and fine-grained control is required. Open Policy Agent (OPA) offers a unified framework for defining and enforcing policies consistently across various platforms like microservices, APIs, and Kubernetes clusters. This consistent policy management is vital for security, compliance, consistency, and agility within enterprises. By utilizing an API gateway, such as Kong Gateway, as a central control point, organizations can enforce access control policies and other security measures uniformly, reducing the risk of misconfigurations and allowing developers to focus on business logic. For instance, instead of implementing access control logic in each microservice, policies can be centralized in the API gateway, which can integrate with identity management solutions like Keycloak to ensure only authenticated users have access, thus illustrating how centralized policy management streamlines API security and scalability.

Retrieval-Augmented Generation (RAG) architectures are gaining traction in AI applications by addressing traditional generative AI models' limitations, such as accuracy and hallucinations, by combining retrieval-based systems with generative models like Large Language Models (LLMs). This blog post discusses implementing a RAG application using LangChain as the orchestrator, Amazon Bedrock as the generative model provider, Kong AI Gateway for security and management, and Redis as the vector database. The Kong AI Gateway enhances the deployment of AI applications by integrating AI-focused plugins for data security, response quality, and observability, allowing seamless integration with existing API traffic flows. It also supports multi-LLM integrations, providing features like prompt engineering, semantic caching, and AI analytics. The architecture involves preparing data by converting documents into embeddings stored in Redis, which are then used during query time to enhance LLM prompts with relevant data. The process is orchestrated by LangChain, leveraging Kong AI Gateway to route requests to Amazon Bedrock, ensuring data is contextually enriched and secure. This approach enables the creation of scalable, contextually aware AI applications with advanced RAG capabilities, demonstrating the synergy of modular components in a complex AI ecosystem.

The latest release of Insomnia, version 10.1, builds on the recent v10 update by introducing several new features, including the general availability of the CLI for using the Collection Runner with CI/CD automation and an in-app invite wizard for seamless collaboration. The Insomnia CLI, known as "Inso," allows users to automate the running of API collections in CI/CD pipelines, supporting platforms like GitHub Actions and Jenkins, while also offering advanced configurations. This enhancement ensures the reliability of APIs by enabling quick detection of inconsistencies or errors. Additionally, the new in-app invite dialog simplifies the process of managing and inviting collaborators directly from the desktop application, enhancing the collaboration experience, especially when projects are stored on Insomnia Cloud. The release also improves user experience by automatically configuring proxy settings based on the operating system, with customization options available in the application’s preferences.

Kong Insomnia has introduced support for SCIM (System for Cross-domain Identity Management) to automate the provisioning and deprovisioning of user accounts through third-party identity providers (IDPs), enhancing the onboarding process for enterprise users. This feature, available to all Enterprise plan customers, works in conjunction with existing enterprise SSO functionalities and supports OIDC and SAML-compatible IDPs like Okta. The integration includes a wizard for provisioning a secret token, enabling Insomnia to handle user account requests automatically based on IDP grouping rules, thus ensuring secure access to API assets. It is compatible with optional end-to-end encryption and other security features, such as Storage Control, which allows API assets to be stored locally or on Git. This enhancement underscores Insomnia's commitment to security, allowing enterprises to manage access to sensitive API assets while maintaining productivity in API design, debugging, and testing. Existing enterprise customers are encouraged to utilize SCIM onboarding by accessing their Enterprise Controls settings.