NVIDIA H100 GPUs are here

Replicate has introduced the availability of NVIDIA H100 GPUs, as well as multi-GPU configurations of A100 and L40S GPUs, which were previously exclusive to deployments but are now accessible for regular model training. The new offerings aim to enhance model performance and provide users with more powerful computational options. Pricing for these GPUs varies based on configuration, with specific rates for 1x, 2x, 4x, and 8x setups of H100, A100, and L40S GPUs. Users can create new models using the H100 GPUs via the web or HTTP API, and can check available hardware options through API commands. Additionally, existing deployments can be updated to incorporate these new GPU configurations, with support available for optimal setup guidance.