mlsanityData to 7 Oct 2026

Do 3D Medical Foundation Models See Through MRI Artifacts? A Controlled Study of Representation Robustness

arXiv 2608.06613 ↗First posted 6 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised 3D medical foundation models are increasingly used as general-purpose feature extractors, yet their sensitivity to MRI artifacts remains poorly understood. We present a controlled evaluation of representation robustness across five pretrained 3D encoders spanning different architectures, objectives, pretraining domains, and dataset scales. Using BraTS-Africa cases with four MRI sequences, we generate seven frequency- and image-domain artifacts at five predefined corruption settings. Robustness is assessed using linear centered kernel alignment (CKA), RankMe, and UMAP, complemented by an independent segmentation-consistency analysis. We find that robustness is strongly model- and artifact-dependent. 3DINO exhibits the most consistently stable representations, while BrainIAC is highly sensitive to several corruptions; NeuroVFM, BrainFM, and Neuro-SimCLR show intermediate but distinct artifact-specific profiles. Across many conditions, CKA decreases substantially while RankMe remains comparatively stable, indicating that artifacts often distort representation geometry without causing dimensional collapse. Segmentation consistency also degrades under corruption, particularly for ghosting and Rician noise, but aligns only partially with representation-level robustness. These findings show that larger-scale or domain-specific pretraining alone does not guarantee artifact invariance and motivate explicit robustness evaluation before deploying 3D foundation models in heterogeneous MRI settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

12 of 27 references.

References · 12

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  3. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  4. 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 176
  5. 2022RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rankcited by 145
  6. 2019Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effectscited by 40
  7. 2025A generalizable 3D framework and model for self-supervised learning in medical imagingcited by 26
  8. 2015Gibbs-Ringing Artifact Removal Based on Local Subvoxel-shiftscited by 13
  9. 2022FAST-AID Brain: Fast and Accurate Segmentation Tool using Artificial Intelligence Developed for Braincited by 10
  10. 2025Building a General SimCLR Self-Supervised Foundation Model Across Neurological Diseases to Advance 3D Brain MRI Diagnosescited by 9
  11. 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imagingcited by 5
  12. 2024Non-Reference Quality Assessment for Medical Imaging: Application to Synthetic Brain MRIscited by 4

Built on by

Not cited yet.