Home / Companies / Together AI / Blog / Post Details
Content Deep Dive

Fine-tuning Llama-3 to get 90% of GPT-4’s performance at a fraction of the cost

Blog post from Together AI

Post Details
Company
Date Published
Author
Hassan El Mghari
Word Count
1,292
Language
English
Hacker News Points
3
Summary

The success of Llama-3 has been incredible, proving that open source models are rapidly catching up to closed models without compromising private ownership. Customers have been using their own proprietary data to fine-tune small OSS models like Llama-3 to run tasks with greater accuracy than even top closed-source models can achieve. A custom model created through this process outperforms leading OSS alternatives, surpasses a top closed-source alternative, and achieves over 90% of GPT-4o's accuracy while being much faster and cheaper, giving users full ownership of the model and weights. This approach results in smaller, faster, and more accurate models for specific tasks without compromising flexibility or ownership, all at a lower cost than using proprietary models like GPT-4.