mlsanityData to 14 Oct 2026

Are Natural-Domain Foundation Models Effective for Accelerated Cardiac MRI Reconstruction?

arXiv 2604.22557 ↗First posted 24 Apr 2026eess.IV cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The emergence of large-scale pretrained foundation models has transformed computer vision, enabling strong performance across diverse downstream tasks. However, their potential for physics-based inverse problems, such as accelerated cardiac MRI reconstruction, remains largely underexplored. In this work, we investigate whether natural-domain foundation models can serve as effective image priors for accelerated cardiac MRI reconstruction, and compare the performance obtained against domain-specific counterparts such as BiomedCLIP. We propose an unrolled reconstruction framework that incorporates pretrained, frozen visual encoders, such as CLIP, DINOv2, and BiomedCLIP, within each cascade to guide the reconstruction process. Through extensive experiments, we show that while task-specific state-of-the-art reconstruction models such as E2E-VarNet achieve superior performance in standard in-distribution settings, foundation-model-based approaches remain competitive. More importantly, in challenging cross-domain scenarios, where models are trained on cardiac MRI and evaluated on anatomically distinct knee and brain datasets--foundation models exhibit improved robustness, particularly under high acceleration factors and limited low-frequency sampling. We further observe that natural-image-pretrained models, such as CLIP, learn highly transferable structural representations, while domain-specific pretraining (BiomedCLIP) provides modest additional gains in more ill-posed regimes. Overall, our results suggest that pretrained foundation models offer a promising source of transferable priors, enabling improved robustness and generalization in accelerated MRI reconstruction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 24 Apr 2026.

Builds on

31 of 41 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2016Layer Normalizationcited by 5,669
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  8. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  9. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  10. 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
  11. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
  12. 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 202
19 more
  1. 2023From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Modelscited by 98
  2. 2022What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factorscited by 61
  3. 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?cited by 46
  4. 2023CLIP in Medical Imaging: A Surveycited by 40
  5. 2019Depthwise Convolution is All You Need for Learning Multiple Visual Domainscited by 36
  6. 2021Recurrent Variational Network: A Deep Learning Inverse Problem Solver applied to the task of Accelerated MRI Reconstructioncited by 34
  7. 2023Evaluating General Purpose Vision Foundation Models for Medical Image Analysis: An Experimental Study of DINOv2 on Radiology Benchmarkscited by 33
  8. 2022HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstructioncited by 30
  9. 2023CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstructioncited by 21
  10. 2023Fill the K-Space and Refine the Image: Prompting for Dynamic and Multi-Contrast MRI Reconstructioncited by 17
  11. 2024The state-of-the-art in Cardiac MRI Reconstruction: Results of the CMRxRecon Challenge in MICCAI 2023cited by 15
  12. 2023One-shot Localization and Segmentation of Medical Images with Foundation Modelscited by 14
  13. 2025Data or Language Supervision: What Makes CLIP Better than DINO?cited by 14
  14. 2023Pretrained ViTs Yield Versatile Representations For Medical Imagescited by 13
  15. 2024General Purpose Image Encoder DINOv2 for Medical Image Registrationcited by 11
  16. 2024Navigating Data Scarcity using Foundation Models: A Benchmark of Few-Shot and Zero-Shot Learning Approaches in Medical Imagingcited by 8
  17. 2024Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation?cited by 6
  18. 2025Zero-shot Domain Generalization of Foundational Models for 3D Medical Image Segmentation: An Experimental Studycited by 3
  19. 2025Foundation Models in Medical Image Analysis: A Systematic Review and Meta-Analysiscited by 3

Built on by

Not cited yet.