Easier evaluations with LangSmith SDK v0.2

LangSmith has released version 0.2 of its SDKs, introducing several enhancements to improve the developer experience for application evaluation in both Python and TypeScript. Key updates include simplified usage of the evaluate() and aevaluate() methods, improved performance, and expanded documentation. Developers can now create simpler custom evaluators using dict inputs and outputs, and they can run evaluations locally without uploading results, a feature currently in beta for Python. The update also consolidates evaluation methods, making evaluate() the primary method for application and experimental evaluations. Additionally, the Python SDK now features a 30% performance boost for handling large example evaluations, and the documentation has been extensively revamped. This release includes breaking changes, such as altering default concurrency settings and changing the handling of string data arguments to check for UUIDs. Support for Python 3.8 has been discontinued.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.