Hippocratic AI partners with Modular to power flexible, high-quality inference for real-time patient conversations

Hippocratic AI is advancing the use of AI in healthcare by developing safety-focused AI health agents that engage in patient conversations, addressing a global healthcare worker shortage. Their Polaris system employs multiple specialized models to ensure interactions are clinically safe, achieving lower error rates than human clinicians and scaling to contact tens of thousands of patients daily. Their collaboration with Modular involves integrating the MAX framework into Hippocratic AI's inference pipelines, optimizing performance with NVIDIA B300 GPUs and enhancing latency management. This partnership allows for flexible, hardware-agnostic deployment of large reasoning models, contributing to efficient patient interactions and maintaining trust in highly regulated industries. Hippocratic AI, which has received $404 million in funding from prominent investors, focuses on non-diagnostic, patient-facing clinical AI agents and avoids using its technology for prescribing or diagnosing, aiming to make healthcare accessible worldwide.