Lance Blob V2: Making Multimodal Data a First-Class Citizen in the Lakehouse

Lance Blob V2 aims to elevate multimodal data, such as images, audio, and video, to first-class citizens within data systems, addressing longstanding challenges associated with handling binary large objects (blobs). Traditional systems often treat blobs as secondary to scalar data, leading to fragmented governance and operational complexity. Lance Blob V2 introduces a multi-semantic storage approach, allowing for various storage strategies—Inline, Packed, Dedicated, and External—based on object size and characteristics, which improves performance and manageability in AI and multimodal workloads. This approach also enables seamless integration with existing media libraries by treating external references as first-class entities, thus simplifying migration and lifecycle governance. By unifying the blob handling process across different storage semantics and ensuring efficient system-level layouts, Lance Blob V2 provides a consistent and robust platform for managing multimodal data, similar to how Git manages code, ultimately allowing AI teams to focus more on model development rather than data pipeline complexities.