LangSmith CLI & Skills

A new CLI is being introduced alongside a set of skills to enhance AI coding agents' capabilities within the LangSmith ecosystem, significantly improving performance metrics from 17% to 92% on certain tasks. The LangSmith CLI enables coding agents to efficiently interact with LangSmith by providing tools for tracing, dataset curation, and experiment execution, thus facilitating a terminal-first approach that is deemed crucial for future agent development. Skills, which are dynamically loaded based on task relevance, help improve agent performance without overwhelming them with unnecessary tools and are both portable and shareable. The initial set of LangSmith skills focuses on tracing, dataset building, and evaluation, aiming to create a virtuous cycle in agent development by allowing agents to add tracing logic, debug behavior, build testing datasets, and validate correctness through evaluations. Installation options are available for both local and global projects, and the initiative encourages community feedback and contributions for future skill enhancements.