mlsanityData to 7 Oct 2026

Universality Reconsidered: Rethinking the Validation of Foundation Models for General-Purpose 3D Medical Segmentation

arXiv 2602.07643 ↗First posted 7 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Foundation models have emerged as a transformative paradigm in 3D medical imaging, with the promise of unified quantitative analysis across diverse targets and imaging modalities. Yet the prevailing conception of universality remains incomplete. Current models are predominantly developed and evaluated on datasets largely concentrated around a limited set of imaging modalities and anatomical regions. In this Perspective, we evaluate representative 3D segmentation foundation models using paired whole-body structural and functional imaging data. Our analysis reveals a substantial gap between benchmark-reported performance and real-world generalization, with marked degradation on previously unseen data and particularly severe failures on functional imaging modalities. These findings suggest that current foundation models remain far from achieving true universality. We argue that progress requires not only scaling models and datasets, but also a reconsideration of how universality is defined and validated, extending evaluation beyond regional structural benchmarks toward whole-body structural and functional imaging. Our observations highlight the need to distinguish benchmark success from genuine clinical generalization. Bridging this gap will be essential for translating foundation models from controlled evaluation settings to real-world medical practice.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 7 Feb 2026.

Builds on

16 of 28 references.

References · 16

  1. 2023Segment Anythingcited by 8,158
  2. 2021The Medical Segmentation Decathloncited by 620
  3. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  4. 2017Deep Learning for Medical Image Analysiscited by 399
  5. 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
  6. 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 222
  7. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  8. 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
  9. 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
  10. 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 86
  11. 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 62
  12. 2023Large-Vocabulary Segmentation for Medical Images with Text Promptscited by 60
4 more
  1. 2025nnInteractive: Redefining 3D Promptable Segmentationcited by 39
  2. 2024Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?cited by 31
  3. 2020Bridging 2D and 3D Segmentation Networks for Computation Efficient Volumetric Medical Image Segmentation: An Empirical Study of 2.5D Solutionscited by 30
  4. 2021Deep Learning methods for automatic evaluation of delayed enhancement-MRI. The results of the EMIDEC challengecited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.