Home / Companies / Portkey / Blog / Post Details
Content Deep Dive

We Tracked $93M in LLM Spends Last Year. Now the Data is Yours.

Blog post from Portkey

Post Details
Company
Date Published
Author
Vrushank Vyas
Word Count
717
Language
English
Hacker News Points
-
Summary

In the complex landscape of Large Language Model (LLM) pricing, various providers employ different metrics such as tokens, characters, and compute units, leading to confusion and the need for constantly updated spreadsheets to track costs. This inconsistency is compounded by issues like varying model names, disparate unit charges, hidden surcharges, and frequent price changes that make maintaining accurate cost data challenging. While there have been efforts like Theo's GitHub Gist, LiteLLM's Pricing JSON, and OpenRouter's API to address these issues, they each have limitations such as manual updates, lack of APIs, or authentication barriers. Portkey aims to solve this by open-sourcing a comprehensive and dynamic database that tracks pricing and usage data for over 2,000 models across 40+ providers, offering a free API without authentication and a community-maintained GitHub repository, ensuring accuracy and accessibility for enterprises relying on LLMs for significant daily operations.