How Pendo used LangSmith to trace Novus from user behavior to code fixes

Pendo's Novus is a product agent designed to automatically detect usability issues in live applications, promptly fix the underlying code, and enhance the overall user experience, achieving a 90%+ success rate in evaluations. The integration of LangSmith tracing has been pivotal, allowing for detailed monitoring and debugging of Novus in production by providing comprehensive trace views that reveal user interactions and system behaviors. Novus utilizes product analytics and session replays to identify and address actionable issues, correlating user behavior with specific code files and suggesting fixes, thereby closing the feedback loop between developers and product managers. This approach allows product teams to maintain high shipping velocity without sacrificing quality, as Novus automatically corrects issues before they become significant problems. The use of LangSmith for trace tagging and cost monitoring ensures efficient resource allocation and insights into customer usage, enabling tailored product improvements and outreach strategies.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.