If you’re using the ChatCompletions API and want to experiment with open source LLMs, a new endpoint has been created on Baseten that’s compatible with OpenAI's API, allowing for seamless migration to models like Mistral 7B. This bridge enables one-click model deployment, zero pip install commands, and only three tiny code changes are needed to update from GPT-3.5 to open source LLMs. The new endpoint supports streaming inference as well, and a curated library of open source models is available for exploration.