Nemotron 3 Nano 4B: A Compact Hybrid Model for Efficient Local AI

Nemotron 3 Nano 4B, introduced as the latest addition to the Nemotron 3 family, is a compact hybrid AI model designed to deliver efficient local AI performance while maintaining a minimal VRAM footprint. Utilizing a hybrid Mamba-Transformer architecture, it excels in instruction following, gaming intelligence, and VRAM efficiency, making it ideal for edge deployment on NVIDIA platforms like Jetson and RTX GPUs. The model, pruned and distilled from its predecessor Nemotron Nano 9B v2 using the Nemotron Elastic framework, offers state-of-the-art accuracy and efficiency across various applications, from conversational agents to gaming. It supports open-source customization and domain-specific optimization, further enhanced by quantization techniques that reduce model size for edge efficiency, achieving significant improvements in latency and throughput. Available on various inference engines and platforms, Nemotron 3 Nano 4B exemplifies a balance between compact design and high performance for diverse AI deployment scenarios.