Expanding our Agentic Inference Cloud: Introducing GPU Droplets Powered by AMD Instinct™ MI350X GPUs
Blog post from DigitalOcean
DigitalOcean has announced the introduction of high-performance GPU Droplets powered by AMD Instinct™ MI350X GPUs within its Agentic Inference Cloud, aimed at enhancing AI-native companies' ability to handle complex inference workloads. These GPUs, built on the AMD CDNA™ 4 architecture, are optimized for demanding tasks such as training massive models and performing high-speed inference, offering benefits like lower latency and higher throughput. The collaboration between DigitalOcean and AMD has already yielded significant results, including a 2X increase in production request throughput and a 50% reduction in inference costs for customers like Character.AI. The new GPU Droplets offer predictable, cost-effective pricing, simple setup, and access to enterprise-grade features, making them attractive for developers and emerging businesses. These advancements are available at DigitalOcean's Atlanta data center, with plans to deploy AMD Instinct™ MI355X GPUs next quarter to support even larger datasets and models.