LangSmith LLM Gateway: runtime governance built into the agent lifecycle

LangSmith has introduced the LangSmith LLM Gateway in private beta, a governance layer designed to integrate seamlessly with the existing LangSmith framework where agents are built, observed, and evaluated. Positioned between agents and LLM providers, it enforces cost limits and redacts sensitive data, streamlining policy enforcement and observability without requiring external dashboards or tools. The Gateway offers features such as spend limits, real-time cost visibility, and sensitive data redaction, all within the LangSmith workspace to maintain trace continuity and ease policy management. This integration allows teams to detect, investigate, and remediate issues without leaving the LangSmith environment, reducing the need for multiple tools and context switches. By anchoring governance to the agent framework, the Gateway aims to provide a comprehensive control plane for runtime policies, covering not only LLM calls but potentially all aspects of agent interactions, with plans to expand security controls and enforcement flexibility.