Home / Companies / Unsloth / Blog / Post Details
Content Deep Dive

Phi-3 support, Llama 3 bug fixes, Mistral v0.3

Blog post from Unsloth

Post Details
Company
Date Published
Author
Daniel & Michael
Word Count
901
Company Posts That Month
1
Language
English
Hacker News Points
-
Post removed?
No
Summary

Unsloth has announced support for Phi-3 models and resolved issues affecting Llama 3 finetuning, recommending the use of their base or Instruct notebooks for optimal performance. The company has made significant improvements in model speed and memory efficiency, notably making Phi-3 models 2x faster with 50% less memory usage and Mistral v0.3 models 2.2x faster with 73% less VRAM. They have addressed common misconceptions and technical problems with Llama 3 finetuning, such as double BOS tokens and quantization issues, and offer auto-fixes through their platform. Unsloth's Mistral-fied Phi-3 models have shown comparable accuracy to the original versions, with optimizations allowing for longer context lengths. The company has also been selected for GitHub's annual Accelerator Program, marking a significant milestone in their growth, and encourages community engagement through platforms like Discord and Ko-fi.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
AI Model Fine-tuning 8 415 91 58 -44%
LLM 1 2,643 305 124 -22%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.