Weights uses Northflank to scale to millions of users without a DevOps team

JonLuca DeCaro, an experienced engineer from Citadel and Pinterest, chose Northflank to scale Weights, an AI platform, into a multi-cloud, GPU-optimized system serving millions, despite having the capability to build infrastructure from scratch. By leveraging Northflank, Weights operates seamlessly across nine clusters on AWS, GCP, and Azure, managing 40+ microservices and over 250 concurrent GPUs, while automating processes such as container orchestration and workload scheduling. This allows a small team to efficiently handle tasks typically requiring a full DevOps team, enabling rapid cloud migration, aggressive cost optimization, and significant performance improvements such as reducing model load time from 7 minutes to 55 seconds. Northflank's infrastructure-as-code capabilities and integrated tools for deployment, monitoring, and resource management provide a streamlined developer experience, allowing Weights to focus on product development and scaling, rather than infrastructure, ultimately saving time and reducing costs dramatically.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.