mlsanityData to 7 Oct 2026

CMRVision: A Foundation Model for Cardiac MR Image Analysis

arXiv 2609.01308 ↗First posted 1 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Cardiac magnetic resonance (CMR) imaging provides complementary information on cardiac anatomy, function, and tissue characterization across multiple sequences and views. In this work, we investigate foundation model pretraining for 2D CMR and introduce CMRVision, a CMR-specific foundation model trained using DINOv3-style self-supervised learning on a multi-center, multi-sequence cohort of 36 million CMR images. We systematically evaluate architectural and training design choices for domain-specific pretraining. CMRVision is evaluated on two downstream tasks: multi-task segmentation across cine, late gadolinium enhancement (LGE), and mapping sequences, and cine view classification. Our experiments show that CMR-specific pretraining, smaller patch sizes, and patch-level objectives consistently improve downstream performance. Across a multi-task segmentation benchmark, CMRVision achieved the strongest overall performance, outperforming prior natural-image (NI), medical-image, supervised, and CMR foundation model baselines. Improvements were modest but consistent across structures and sequences, with Dice scores ranging from 0.940-0.967 for LV and 0.855-0.905 for myocardium, and reaching 0.929 for RV, 0.920 for LA, and 0.931 for RA. The largest gains were observed for myocardium segmentation in LGE and mapping images. In a zero-shot segmentation task on unseen LGE long-axis views, the model achieved an average Dice score of 0.692, demonstrating cross-view generalization. For cine view classification, CMRVision achieved the highest average accuracy (0.906), compared to prior methods reported in the literature. These results highlight the potential of CMRVision to support robust and generalizable cardiac MRI analysis across multiple sequences and views.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

24 of 33 references.

References · 24

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2025DINOv3cited by 1,297
  7. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  8. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  9. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  10. 2024Rotary Position Embedding for Vision Transformercited by 226
  11. 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 151
  12. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
12 more
  1. 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 61
  2. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  3. 2020Cardiac Segmentation on Late Gadolinium Enhancement MRI: A Benchmark Study from Multi-Sequence Cardiac MR Segmentation Challengecited by 41
  4. 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
  5. 2024Less Could Be Better: Parameter-efficient Fine-tuning Advances Medical Vision Foundation Modelscited by 17
  6. 2024Towards a vision foundation model for comprehensive assessment of Cardiac MRIcited by 13
  7. 2020Cascaded Convolutional Neural Network for Automatic Myocardial Infarction Segmentation from Delayed-Enhancement Cardiac MRIcited by 12
  8. 2025A versatile foundation model for cine cardiac magnetic resonance image analysis taskscited by 12
  9. 2023A Generalizable Deep Learning System for Cardiac MRIcited by 8
  10. 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registrationcited by 7
  11. 2025DINOv3 with Test-Time Training for Medical Image Registrationcited by 6
  12. 2024On Partial Prototype Collapse in the DINO Family of Self-Supervised Methodscited by 4

Built on by

Not cited yet.