Home / Companies / Lambda / Blog / Post Details
Content Deep Dive

Unbox one of NVIDIA's first co-packaged optics switches with us. See why we bet on CPO early.

Blog post from Lambda

Post Details
Company
Date Published
Author
Khushboo Goel
Word Count
1,292
Language
English
Hacker News Points
-
Summary

Designing large GPU clusters has increasingly emphasized the importance of network infrastructure, particularly as workloads shift towards more complex, agentic tasks that demand significant data movement across clusters. At scales like 800G and NVIDIA GB300 NVL72, networking power becomes a critical component, accounting for a majority of the power consumption. Co-packaged optics (CPO), such as the NVIDIA Quantum-X InfiniBand Photonics Q3450-LD switch, offer a promising solution by reducing power consumption and failure points in the network, thereby increasing the availability of power for GPUs and enhancing reliability. This shift in architecture supports more efficient data center operations by allowing for higher token capacity and minimizing idle GPU time caused by network interruptions. The integration of CPO technology into large GPU clusters like NVIDIA GB300 NVL72 involves a more disciplined approach to infrastructure planning, including cooling and power distribution, to improve operational efficiency and accommodate the growing demands of agentic workloads.