Polly is generally available everywhere you work in LangSmith

Polly is an AI assistant designed to aid in debugging complex agent traces within LangSmith by efficiently analyzing extensive steps and prompts to identify issues and provide insights. Now generally available, Polly has been integrated across all LangSmith pages, enhancing its capabilities and accessibility. This AI assistant not only retains context across navigation but also performs actions like updating prompts, creating datasets from failed runs, and writing evaluator code, effectively acting as a hands-on team member. By following workflows seamlessly, Polly helps users manage intricate debugging tasks, understand user sentiment in conversations, and refine evaluator logic. It also assists in making data-driven decisions by comparing experiment results and providing recommendations based on actual data. Developed through experience with teams building production agents, Polly addresses recurring challenges in the debugging process and supports users by handling tasks that typically slow down engineering efforts. Users can easily access Polly on LangSmith by setting up an API key, enhancing their ability to monitor and improve their workflows.