Click-to-Segment: Brining AI-powered Interactive Segmentation to FiftyOne Labs

Click-to-Segment is a feature integrated into FiftyOne Labs that revolutionizes segmentation annotation by utilizing AI-powered interactive segmentation tools. This feature allows users to create segmentation masks with just a few clicks, leveraging promptable segmentation models like the Segment Anything Model (SAM) from the FiftyOne Model Zoo. Users can enable Click Capture to generate instance-level keypoints for fine-grained control over segmentation masks, which are then displayed within the FiftyOne App. The feature supports both positive and negative point prompts, offering flexibility in mask creation, and includes a Segment with Prompts operator for batched inference. This tool addresses the limitations of traditional polygon-based annotation methods, making it easier to build high-quality segmentation datasets directly within the existing data management workflow in FiftyOne.