What is Segment Anything 2 (SAM 2)?

Segment Anything 2 (SAM 2), introduced by Meta AI in July 2024, is a cutting-edge open-source model designed for real-time image and video segmentation tasks. Building on its predecessor, SAM 2 offers enhanced accuracy—six times better for image segmentation—through its ability to generate segmentation masks by using point prompts or an automatic mask generator. The model was trained on the extensive Segment Anything Video dataset, which includes a significant number of annotated videos, enhancing the speed and efficiency of the labeling process. SAM 2 is available in four versions, varying in size and accuracy, and achieves state-of-the-art performance on several video segmentation benchmarks. The model supports segmentation on CUDA-enabled GPU devices and can be combined with the grounding model Florence-2 to enable text-based prompts for identifying specific objects, thereby expanding its utility in vision projects.