Natural-Language Video Search in FiftyOne with TwelveLabs

TwelveLabs and FiftyOne have integrated their technologies to enhance video data handling through natural-language video search, transforming how users interact with video datasets. TwelveLabs provides video foundation models like Marengo and Pegasus, which enable embedding video clips into a shared space with text for easy searching by description, and generating natural-language captions and answers for video content. This integration allows users to embed, search, and caption videos using plain English without the need for local GPUs, as computations occur server-side via the TwelveLabs API. FiftyOne, an open-source toolkit, complements this by offering a visual app for exploring images and video, employing a query language for data slicing, and a "Brain" layer for advanced analysis, thereby facilitating better data curation. This partnership unlocks enhanced functionalities such as natural-language video search, zero-shot captioning, similarity detection, and embedding visualizations, enabling users to manage video datasets more efficiently and intuitively.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.