Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond
Not on the map. Why?
Abstract (arXiv)
Cardiac magnetic resonance imaging is the gold standard for non-invasive cardiac assessment, offering rich spatio-temporal views of the cardiac anatomy and physiology. Patient-level health factors, such as demographics, metabolic, and lifestyle, are known to substantially influence cardiovascular health and disease risk, yet remain uncaptured by CMR alone. To holistically understand cardiac health and to enable the best possible interpretation of an individual's disease risk, CMR and patient-level factors must be jointly exploited within an integrated framework. Recent multi-modal approaches have begun to bridge this gap, yet they often rely on limited spatio-temporal data and focus on isolated clinical tasks, thereby hindering the development of a comprehensive representation for cardiac health evaluation. To overcome these limitations, we introduce ViTa, a step toward foundation models that delivers a comprehensive representation of the heart and a precise interpretation of individual disease risk. Leveraging data from 42,000 UK Biobank participants, ViTa integrates 3D+T cine stacks from short-axis and long-axis views, enabling a complete capture of the cardiac cycle. These imaging data are then fused with detailed tabular patient-level factors, enabling context-aware insights. This multi-modal paradigm supports a wide spectrum of downstream tasks, including cardiac phenotype and physiological feature prediction, segmentation, and classification of cardiac and metabolic diseases within a single unified framework. By learning a shared latent representation that bridges rich imaging features and patient context, ViTa moves beyond traditional, task-specific models toward a universal, patient-specific understanding of cardiac health, highlighting its potential to advance clinical utility and scalability in cardiac analysis.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
33 of 58 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 491
- 2022Scaling Language-Image Pre-training via Maskingcited by 317
- 2023Towards Generalist Biomedical AIcited by 289
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2019Deep learning for cardiac image segmentation: A reviewcited by 131
- 2022Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentationcited by 69
21 more
- 2023Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Datacited by 69
- 2018Joint Learning of Motion Estimation and Segmentation for Cardiac MR Image Sequencescited by 47
- 2024TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Datacited by 32
- 2023NISF: Neural Implicit Segmentation Functionscited by 29
- 2019Learning Shape Priors for Robust Cardiac MR Segmentation from Multi-view Imagescited by 16
- 2022MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View Cardiac MRIcited by 16
- 2023Unlocking the diagnostic potential of electrocardiograms through information transfer from cardiac magnetic resonance imagingcited by 14
- 2024Towards a vision foundation model for comprehensive assessment of Cardiac MRIcited by 14
- 2021Joint Motion Correction and Super Resolution for Cardiac Segmentation via Latent Optimisationcited by 12
- 2022Learning-based and unrolled motion-compensated reconstruction for cardiac MR CINE imagingcited by 11
- 2024Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Imagescited by 9
- 2023Motion-compensated MR CINE reconstruction with reconstruction-driven motion estimationcited by 8
- 2023A Generalizable Deep Learning System for Cardiac MRIcited by 8
- 2024Classification, Regression and Segmentation directly from k-Space in Cardiac MRIcited by 8
- 2021A Multimodal Deep Learning Model for Cardiac Resynchronisation Therapy Response Predictioncited by 7
- 2024Spatio-temporal neural distance fields for conditional generative modeling of the heartcited by 7
- 2024Direct Cardiac Segmentation from Undersampled K-space Using Transformerscited by 5
- 2023Multimodal Representation Learning of Cardiovascular Magnetic Resonance Imagingcited by 4
- 2023Assessment of Deep Learning Segmentation for Real-Time Free-Breathing Cardiac Magnetic Resonance Imaging at Rest and Under Exercise Stresscited by 4
- 2024Attention-aware non-rigid image registration for accelerated MR imagingcited by 4
- 2024Interpretable Multimodal Learning for Cardiovascular Hemodynamics Assessmentcited by 2
Built on by
Citing papers per year: 2025: 6; 2026: 8.
14 papers.
Sort:
By area:
- 2025A versatile foundation model for cine cardiac magnetic resonance image analysis taskscited by 12
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registrationcited by 7
- 2025Unleashing the Power of Image-Tabular Self-Supervised Learning via Breaking Cross-Tabular Barrierscited by 5
- 2025Latent Interpolation Learning Using Diffusion Models for Cardiac Volume Reconstructioncited by 3
- 2025M3Ret: Unleashing Zero-shot Multimodal Medical Image Retrieval via Self-Supervisioncited by 2
- 2025Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with A Generalist Foundation Model and Multimodal Databasecited by 2
- 2026No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Spacecited by 0
- 2026Med-DualLoRA: Local Adaptation of Foundation Models for 3D Cardiac MRIcited by 0
- 2026Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representationscited by 0
- 2026MARCUS: An agentic, multimodal vision-language model for cardiac diagnosis and managementcited by 0
- 2026Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRIcited by 0
- 2026Foundation Models Adaptation for Multi-View Multi-modal Cardiac MRI Segmentation and Direct Ejection Fraction Estimationcited by 0
- 2026MMAP: Multimodal Missing-Aware Pretraining for Longitudinal Alzheimer's Prediction22 Sep 2026
- 2026ORION-CMR: On-scanner Reporting with Integrated Foundation Model for End-to-End Cardiac MRI Analysis and Interpretation20 Sep 2026
- 2026Foundation Models Adaptation for Multi-View Multi-modal Cardiac MRI Segmentation and Direct Ejection Fraction Estimation7 Aug 2026
- 2026Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRI27 Jun 2026
- 2026MARCUS: An agentic, multimodal vision-language model for cardiac diagnosis and management23 Mar 2026
- 2026Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representations13 Mar 2026
- 2026Med-DualLoRA: Local Adaptation of Foundation Models for 3D Cardiac MRI11 Mar 2026
- 2026No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Space10 Mar 2026
- 2025Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with A Generalist Foundation Model and Multimodal Database25 Dec 2025
- 2025Unleashing the Power of Image-Tabular Self-Supervised Learning via Breaking Cross-Tabular Barriers16 Dec 2025
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registration8 Sep 2025
- 2025M3Ret: Unleashing Zero-shot Multimodal Medical Image Retrieval via Self-Supervision1 Sep 2025
- 2025A versatile foundation model for cine cardiac magnetic resonance image analysis taskscited by 12
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registrationcited by 7
- 2025Unleashing the Power of Image-Tabular Self-Supervised Learning via Breaking Cross-Tabular Barrierscited by 5
- 2025M3Ret: Unleashing Zero-shot Multimodal Medical Image Retrieval via Self-Supervisioncited by 2
- 2025Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with A Generalist Foundation Model and Multimodal Databasecited by 2
- 2026No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Spacecited by 0
- 2026Med-DualLoRA: Local Adaptation of Foundation Models for 3D Cardiac MRIcited by 0
- 2026Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representationscited by 0
- 2026Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRIcited by 0
- 2026Foundation Models Adaptation for Multi-View Multi-modal Cardiac MRI Segmentation and Direct Ejection Fraction Estimationcited by 0
- 2026ORION-CMR: On-scanner Reporting with Integrated Foundation Model for End-to-End Cardiac MRI Analysis and Interpretationcited by 0
- 2026MMAP: Multimodal Missing-Aware Pretraining for Longitudinal Alzheimer's Predictioncited by 0
- 2026MMAP: Multimodal Missing-Aware Pretraining for Longitudinal Alzheimer's Prediction22 Sep 2026
- 2026ORION-CMR: On-scanner Reporting with Integrated Foundation Model for End-to-End Cardiac MRI Analysis and Interpretation20 Sep 2026
- 2026Foundation Models Adaptation for Multi-View Multi-modal Cardiac MRI Segmentation and Direct Ejection Fraction Estimation7 Aug 2026
- 2026Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRI27 Jun 2026
- 2026Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representations13 Mar 2026
- 2026Med-DualLoRA: Local Adaptation of Foundation Models for 3D Cardiac MRI11 Mar 2026
- 2026No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Space10 Mar 2026
- 2025Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with A Generalist Foundation Model and Multimodal Database25 Dec 2025
- 2025Unleashing the Power of Image-Tabular Self-Supervised Learning via Breaking Cross-Tabular Barriers16 Dec 2025
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registration8 Sep 2025
- 2025M3Ret: Unleashing Zero-shot Multimodal Medical Image Retrieval via Self-Supervision1 Sep 2025
- 2025A versatile foundation model for cine cardiac magnetic resonance image analysis tasks31 May 2025