Axis Improves Generation Quality and Lowers Costs With Fine Tuning

Axis, a platform providing multinational enterprises with market insights and regulatory data, developed a new product offering to build an index of global regulations. They faced challenges in scaling their service due to the high cost of GPT-4 and GPT-3.5 models. Fine-tuning their models using OpenPipe's SDK proved to be beneficial, allowing them to lower costs by over 95% per token compared to GPT-4-Turbo. Axis also utilized OpenPipe's automatic evaluation functionality and pruning rules dataset optimization feature, which helped improve model quality and reduce input token usage by over 50%. By deploying multiple fine-tuned models in production, Axis has built a defensible product that powers all customer traffic, outperforming GPT-4 in some cases.