Robustness of Deep Learning for Accelerated MRI: Benefits of Diverse Training Data
Not on the map. Why?
Abstract (arXiv)
Deep learning based methods for image reconstruction are state-of-the-art for a variety of imaging tasks. However, neural networks often perform worse if the training data differs significantly from the data they are applied to. For example, a model trained for accelerated magnetic resonance imaging (MRI) on one scanner performs worse on another scanner. In this work, we investigate the impact of the training data on a model's performance and robustness for accelerated MRI. We find that models trained on the combination of various data distributions, such as those obtained from different MRI scanners and anatomies, exhibit robustness equal or superior to models trained on the best single distribution for a specific target distribution. Thus training on such diverse data tends to improve robustness. Furthermore, training on such a diverse dataset does not compromise in-distribution performance, i.e., a model trained on diverse data yields in-distribution performance at least as good as models trained on the more narrow individual distributions. Our results suggest that training a model for imaging on a variety of distributions tends to yield a more effective and robust model than maintaining separate models for individual distributions.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 43 of its 62 references that are in the map. First posted on arXiv 16 Dec 2023.
Builds on
43 of 62 references.
References · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2017Deep Image Priorcited by 1,097
- 2021Scaling Vision Transformerscited by 993
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
31 more
- 2021Robust fine-tuning of zero-shot modelscited by 785
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2020Measuring Robustness to Natural Distribution Shifts in Image Classificationcited by 452
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2017Compressed Sensing using Generative Modelscited by 337
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 284
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2022Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP)cited by 137
- 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
- 2020The Effect of Natural Distribution Shift on Question Answering Modelscited by 104
- 2022Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIPcited by 97
- 2020Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challengecited by 59
- 2021Measuring Robustness in Deep Learning Based Compressive Sensingcited by 53
- 2017A Transfer-Learning Approach for Accelerated MRI using Deep Neural Networkscited by 43
- 2022SKM-TEA: A Dataset for Accelerated MRI Reconstruction with Dense Image Labels for Quantitative Clinical Evaluationcited by 42
- 2022Test-Time Training Can Close the Natural Distribution Shift Performance Gap in Deep Learning Based Compressed Sensingcited by 37
- 2023Does CLIP's Generalization Performance Mainly Stem from High Train-Test Similarity?cited by 35
- 2022HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstructioncited by 30
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
- 2022Stable Deep MRI Reconstruction using Generative Priorscited by 21
- 2021Universal Undersampled MRI Reconstructioncited by 15
- 2022Scaling Laws For Deep Learning Based Image Reconstructioncited by 14
- 2023FastMRI Prostate: A Publicly Available, Biparametric MRI Dataset to Advance Machine Learning for Prostate Cancer Imagingcited by 9
- 2023Learning Provably Robust Estimators for Inverse Problems via Jitteringcited by 8
- 2019Generalizing Deep Learning MRI Reconstruction across Different Domainscited by 4
- 2022Deep Learning for Ultrasound Speed-of-Sound Reconstruction: Impacts of Training Data Diversity on Stability and Robustnesscited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 5.
10 papers.
- 2024Deep Learning for Accelerated and Robust MRI Reconstruction: a Reviewcited by 9
- 2024Pruning Unrolled Networks (PUN) at Initialization for MRI Reconstruction Improves Generalizationcited by 3
- 2025Bigger Isn't Always Better: Towards a General Prior for Medical Image Reconstructioncited by 2
- 2024Resolution-Robust 3D MRI Reconstruction with 2D Diffusion Priors: Diverse-Resolution Training Outperforms Interpolationcited by 1
- 2025Diffusion Probabilistic Generative Models for Accelerated, in-NICU Permanent Magnet Neonatal MRIcited by 1
- 2026Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuningcited by 0
- 2026UEPS: Robust and Efficient MRI Reconstructioncited by 0
- 2026MosaicMRI: A Diverse Dataset and Benchmark for Raw Musculoskeletal MRIcited by 0
- 2026MoRE: A Mixture-of-Experts-Based Task-Adaptive End-to-End Network for Multimodal MRI Reconstructioncited by 0
- 2026What Does Attention Transfer Transfer? Attention Structure and Robustness in Vision Transformerscited by 0
- 2026What Does Attention Transfer Transfer? Attention Structure and Robustness in Vision Transformers19 Aug 2026
- 2026MoRE: A Mixture-of-Experts-Based Task-Adaptive End-to-End Network for Multimodal MRI Reconstruction1 Jun 2026
- 2026MosaicMRI: A Diverse Dataset and Benchmark for Raw Musculoskeletal MRI13 Apr 2026
- 2026UEPS: Robust and Efficient MRI Reconstruction19 Mar 2026
- 2026Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuning13 Mar 2026
- 2025Diffusion Probabilistic Generative Models for Accelerated, in-NICU Permanent Magnet Neonatal MRI21 May 2025
- 2025Bigger Isn't Always Better: Towards a General Prior for Medical Image Reconstruction13 Jan 2025
- 2024Pruning Unrolled Networks (PUN) at Initialization for MRI Reconstruction Improves Generalization24 Dec 2024
- 2024Resolution-Robust 3D MRI Reconstruction with 2D Diffusion Priors: Diverse-Resolution Training Outperforms Interpolation24 Dec 2024
- 2024Deep Learning for Accelerated and Robust MRI Reconstruction: a Review24 Apr 2024