Hands-On with NVIDIA DGX Spark: World’s Smallest Supercomputer Meets World’s Smallest Datacenter

NVIDIA's DGX Spark, touted as "the world's smallest AI supercomputer," is a next-generation hardware platform designed for developers to build and test AI applications locally, combining NVIDIA GPUs and CPUs with 128GB of unified memory in a compact form factor. Roboflow's early evaluation of the DGX Spark involved developing a prototype visual AI application to count Waymo vehicles in San Francisco, using the RF-DETR model for real-time object detection. The DGX Spark's ability to handle inference on AI models with up to 200 billion parameters and fine-tune models up to 70 billion parameters locally was put to the test, demonstrating its potential for applications in smart cities and urban planning. The project highlighted the platform's capability to fit into computer vision development workflows, offering a powerful yet compact solution for developing and deploying visual applications at the edge.