Lambda’s NVIDIA HGX 8xB200 on STAC-AI™ LANG6

Lambda has published the first audited STAC-AI™ LANG6 results on the NVIDIA HGX 8xB200, demonstrating significant performance improvements over the NVIDIA 8×H200 NVL in large language model (LLM) inference tasks. The NVIDIA HGX 8xB200 showed superior latency and throughput, particularly under high loads, making it a compelling choice for the financial services industry (FSI) that demands fast, reliable, and scalable infrastructure for tasks such as real-time trading analysis, regulatory compliance, and AI-assisted client advisory. With a 1.4× memory and 1.7× bandwidth advantage, the HGX 8xB200 effectively handles larger model sizes and concurrent requests, reducing latency and increasing batch throughput significantly. This performance is crucial for FSI teams that require rapid response times and high-quality reasoning for complex documents. The independently audited results provide a reliable benchmark for financial institutions considering infrastructure upgrades, ensuring informed decision-making based on verifiable data rather than vendor claims.