Announcing Genkit Middleware: Intercept, extend, and harden your agentic apps

Genkit is an open-source framework designed for creating full-stack, AI-powered applications across various platforms, supporting languages such as TypeScript, Go, Dart, and Python. It emphasizes the necessity of incorporating features like retries, fallbacks, human approvals, and observability to ensure reliability and manage AI-driven applications effectively. To address these needs, Genkit utilizes a middleware system that allows developers to inject custom behaviors into generation calls through composable hooks at different stages of the tool loop. The middleware is currently available in TypeScript, Go, and Dart, with Python support forthcoming. Pre-built middleware solutions include functionalities for retrying failed API calls, switching models on errors, approving tool execution, managing skill sets, and controlling filesystem access. Developers can also create custom middleware to address specific requirements, such as filtering unwanted content, by defining hooks that modify or validate model outputs. Genkit encourages sharing custom middleware as packages for community use and offers a Developer UI for inspecting and debugging middleware configurations and executions.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.