NVIDIA Nemotron 3 Diarization: real-time speaker labels at a cent per audio hour

NVIDIA Nemotron 3 Diarization is an open, transformer-based end-to-end speaker diarization model available through Baseten’s Model Library for prerecorded audio, live streaming, and real-time speaker-attributed transcription. Rather than using separate segmentation, speaker-embedding, and clustering stages, it processes 16 kHz audio into per-speaker activity probabilities for up to eight speakers, maintaining speaker identities across chunks through lightweight state management. A single checkpoint supports configurable algorithmic latency profiles from 320 milliseconds to 30.4 seconds, allowing developers to balance responsiveness and accuracy without redeploying models. Reported benchmarks show relatively small accuracy declines at ultra-low latency and improved diarization error rates over prior Streaming Sortformer versions on datasets including AISHELL-4, while remaining competitive across multilingual benchmarks. Per-speaker activity signals can also support voice activity detection, speaker-specific endpointing, interruption detection, and turn-taking in voice agents. Baseten offers dedicated batch, WebSocket streaming, and diarized transcription presets, with the transcription option integrating NVIDIA Parakeet V2 ASR to handle overlapping speakers in a unified pipeline. On an NVIDIA RTX PRO 6000, Baseten reports capacity exceeding 500 concurrent low-latency diarization streams, or roughly 190 streams with transcription enabled, alongside higher batch throughput than its tested NVIDIA reference configuration.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.