How Lyft Built a Self-Serve AI Agent Platform for Customer Support with LangGraph and LangSmith

Lyft's SCX Data Science and MLE team has innovated a self-serve AI platform that empowers non-technical domain experts to independently develop and refine AI agents, significantly expediting the agent development process from six months to just a few weeks. Utilizing LangGraph's multi-agent architecture and LangSmith's tracing and monitoring tools, the platform supports seamless integration for handling complex customer support issues across various categories like account access and damage claims. This system enables domain experts to create configurable agents using natural language prompts, while maintaining high-quality standards through an automated LLM-as-a-judge evaluation pipeline. The initiative has enhanced operational efficiency and increased AI resolution rates by 16%, highlighting the potential for expanded global deployment and continuous improvement in prompt quality and evaluation coverage.