Home / Companies / Cloudflare / Blog / Post Details
Content Deep Dive

Your AI bill is out of control. Cloudflare can fix it now.Â

Blog post from Cloudflare

Post Details
Company
Date Published
Author
Ming Lu and Kenny Johnson
Word Count
1,483
Language
English
Hacker News Points
-
Summary

With the increasing concerns of CIOs and CFOs regarding AI spending, many companies have been aggressively adopting AI technologies, often resulting in uncontrolled expenses. Cloudflare addresses this issue by introducing spend controls in its AI Gateway, along with a closed beta for identity-driven budgets and routing using Cloudflare Access and existing identity providers. Companies face challenges in tracking AI-related expenditures due to the lack of visibility and control over who uses what, leading to significant costs. AI Gateway helps mitigate this by routing requests through a central point that offers unified billing, logging, and tools to manage AI usage effectively. Now, companies can set spend limits based on models, providers, or custom attributes, and track usage in real time, allowing for better cost management. The introduction of identity-driven budgets further allows for precise cost attribution and control across users and teams. Cloudflare is also developing intelligent task-based routing to optimize costs by selecting the most appropriate model for each task, enhancing both cost control and optimization.