Introducing: H100s on Modal

Modal has introduced access to NVIDIA H100 GPUs for its users, positioning the hardware as a high-performance option for machine learning workloads such as latency-sensitive LLM inference and large-scale model fine-tuning. NVIDIA benchmarks cited in the announcement indicate that H100s can provide up to four times faster training and up to 30 times faster inference than A100 GPUs for large language models. Modal’s H100 instances provide 80 GB of memory per GPU and support configurations of up to eight GPUs connected through NVLink, priced at $7.65 per GPU hour. The platform emphasizes usage-based billing and autoscaling as ways to improve utilization and potentially reduce costs compared with fixed GPU reservations, while users can request an H100 by specifying it as the GPU type in a remote function configuration.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.