New in LangSmith Engine: >2x better issue detection

LangSmith Engine is an in-platform autonomous agent designed to analyze large volumes of production agent traces, identify and group recurring issues, diagnose root causes, propose prompt or code fixes through reviewable pull requests, generate verification datasets, and monitor for regressions. Since launching in May, it has scanned more than 60 million traces and found over 20,000 issues, while recent improvements have more than doubled its performance on the internal IssueBench benchmark and improved fix quality by 25% on public benchmarks such as Terminal-Bench. New capabilities include self-hosted deployment with orchestration inside customer VPCs, Slack and Linear integrations, a lower-cost Reduced Analysis mode, automatic closure of stale issues, and more precise links between detected issues and relevant trace locations. LangSmith plans to add automated verification of proposed fixes against datasets and Engine-generated evaluation datasets, with Engine available to LangSmith Plus and Enterprise customers in SaaS and self-hosted environments.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.