Home / Companies / Cloudflare / Blog / Post Details
Content Deep Dive

Globally distributed AI and a Constellation update

Blog post from Cloudflare

Post Details
Company
Date Published
Author
Rita Kozlov, Celso Martinho
Word Count
1,255
Language
English
Hacker News Points
-
Summary

During Cloudflare's 2023 Developer Week, the company announced Constellation, a set of APIs that enable running fast, low-latency inference tasks using pre-trained machine learning/AI models directly on their network. One month after launching this feature, three new updates have been introduced: increased model size limit from 10 MB to 50 MB, tensor caching for better network latency and faster inference times, and the addition of XGBoost runtime support. Constellation allows developers to deploy globally distributed machine learning applications on Cloudflare's network.