Jolia CT Foundation Model: Interpretability with FiftyOne

Jolia, developed by Raidium, is a 3D CT vision-language foundation model that generates a global [CLS] embedding and 102 named per-organ embeddings from paired chest and abdominal CT scans, without requiring segmentation masks or spatial supervision. FiftyOne, an open-source tool by Voxel51, facilitates the exploration and visualization of these embeddings, allowing for interactive UMAP visualization, per-organ similarity search, and attention heatmap overlays. By using the CT-RATE dataset, the integration of Jolia and FiftyOne demonstrates how per-organ embeddings provide independent views of scans, offering insights into model behavior and interpretability. Jolia's innovative training method, ConQuer, aligns anatomical regions with corresponding report sections, enabling it to achieve state-of-the-art performance in findings classification and report generation. While Jolia and FiftyOne are not intended for clinical diagnosis, they serve as valuable research tools for understanding and improving medical imaging models.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.