One Team, Full Stack: Fully Virtualized H100s, Zero Compromise
Blog post from Lightning AI
Following the merger of Lightning AI and Voltage Park, the combined organization describes building a vertically integrated GPU cloud by controlling its hardware, virtualization, networking, and scheduling layers together. Its approach standardizes H100 nodes through fixed images and detailed validation, hardens Cloud Hypervisor through internal testing and upstream open-source fixes, and exposes real NUMA, CPU, GPU, and NIC topology to guest VMs to improve workload placement and GPUDirect RDMA performance. The company reports that these changes raised host-to-device bandwidth from uneven results of roughly 29–43 GB/s to about 48–49 GB/s across GPUs, compared with about 26 GB/s in its cited GCP test. Its scheduler uses known physical network topology to place multi-node jobs on well-connected machines, preserve contiguous capacity for large training runs, reclaim preemptible spot capacity when needed, and handle concurrent requests efficiently. Lightning AI says the resulting platform operates more than 36,000 AI-focused GPUs, provides managed VMs with near-bare-metal NCCL performance, supports multiple external cloud providers, and benefits from a small cross-disciplinary engineering team working across data centers, hypervisors, schedulers, and developer environments.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Serverless | 2 | 836 | 263 | 107 | -20% |
| LLM | 1 | 7,787 | 1,393 | 257 | +13% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.