Deploy and re-evaluate LLM-powered apps with LangSmith and CircleCI

The tutorial provides a comprehensive guide on building a continuous delivery (CD) pipeline for deploying large language model (LLM) applications using CircleCI. It extends a previous tutorial that covered continuous integration (CI) for testing LLM applications, now focusing on automating deployment to production environments. The process involves running nightly evaluations, allowing for human review of automated test results, and deploying the application after approval. The tutorial emphasizes the importance of monitoring real-world interactions to refine tests, and it demonstrates deploying a Flask server as part of the pipeline. By integrating LLM evaluations into the CI/CD pipeline, developers can streamline the deployment process, reduce manual intervention, and enhance responsiveness to user needs.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.