Introducing Dedicated Endpoints and Custom Weights Hub in Nebius Token Factory

Nebius Token Factory introduces Dedicated Endpoints, which offer granular deployment control for AI models, allowing teams to manage infrastructure variables such as GPU type, scaling limits, and regional data residency directly through a control plane API. This approach replaces the opacity of shared infrastructure with explicit configurations, enabling predictable latency and cost management. The integration of the Custom Weights Hub facilitates a seamless transition from post-training to deployment, allowing fine-tuned or distilled checkpoints to be deployed without tool-switching, thus supporting continuous iteration on models. This system operates on Nebius AI Cloud, using dedicated NVIDIA GPU clusters, and provides Inference Observability for real-time monitoring of latency, scaling behavior, and traffic patterns, ensuring that deployment decisions are informed by actual performance metrics. By integrating deployment as a core component of the production architecture, Nebius enables AI teams to transform model selection into system design, enhancing reliability, compliance, and efficiency at scale.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.