May 2024 Summaries

Arcee Cloud is a new SaaS platform by Arcee.AI designed to simplify the training and deployment of large language models (LLMs) by overcoming common challenges in model development. It offers an end-to-end solution where users can upload datasets, choose an open-source model as a base, and perform various training steps like Continual Pre-Training (CPT), Model Merging, Supervised Fine-Tuning (SFT), and Direct Preference Optimization (DPO) through a user-friendly interface or SDK. A standout feature is its model merging capability, which allows users to combine their domain-specific models with pre-trained open-source models, achieving significant compute savings without sacrificing accuracy. This technique has been refined through a partnership with MergeKit, contributing to its widespread adoption in the LLM community. Arcee Cloud is available as both an in-VPC product and a hosted SaaS solution, allowing for flexible deployment and management of trained models. The platform aims to accelerate the production of custom LLMs, making advanced AI more accessible and efficient for users across various domains.