LLMs In Prod: Day 1

Portkey's analysis of year-end large language model (LLM) production data reveals key trends in the AI ecosystem for 2024, focusing on market dominance and growth among providers. OpenAI remains the leading player with significant monthly growth in requests and organizations, despite a drop in overall adoption from 89% to 76%. Anthropic emerges as the fastest growing provider with substantial spikes in adoption following new model releases, while Google's Gemini shows strong momentum despite a late entry. Cloud providers are leveraging partnerships, with Azure leading in market penetration over AWS Bedrock, which, despite fewer organizations, shows deep usage. Vertex AI is building momentum with notable growth in requests. Additionally, the trend of using multiple providers is rising among Portkey organizations, driven by the need for redundancy to mitigate outages and capacity issues. The analysis will continue with further insights into provider performance in production.