Anyscale has released Anyscale Endpoints, a service that enables developers to integrate fast, cost-efficient, and scalable open-source LLMs using familiar APIs. The new offering provides private end points for self-hosted LLMs, allowing customers to align their usage of LLMs with their security posture while providing enhanced control and configurability. Additionally, Anyscale Endpoints Fine-tuning is now publicly available, enabling developers to use their own data to optimize the quality of OSS Models and build custom tailored applications. The service offers a range of benefits, including state-of-the-art open-source models, an easy serverless approach, fine tuning of LLMs with private data, production readiness, and enhanced observability. Anyscale Endpoints is now available as part of the Anyscale Platform, providing seamless integration with other AI and ML workloads.