Unlocking Adapted LLMs on Enterprise Data

Gretel GPT, an API for generating synthetic natural language text using Large Language Models (LLMs), is set to receive a series of updates over the next few months. The platform enables fine-tuning state-of-the-art LLMs on enterprise data and supports models like MosaicML's mpt-7b, TogetherComputer's RedPajama 3B model, and StabilityAI’s stable LM 3B model. Gretel GPT also offers PEFT (Parameter-Efficient Fine-Tuning) and LORA (Low-Rank Adaptation of Large Language Models) for supported models to create adapted versions with reduced training times and costs. The platform's auto-parameters feature automatically recommends the best configurations for a dataset, based on training hundreds of thousands of models via Gretel’s cloud service.