Data augmentation for deep learning based accelerated MRI reconstruction with limited data
Not on the map. Why?
Abstract (arXiv)
Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To achieve state-of-the-art performance, training on large and diverse sets of images is considered critical. However, it is often difficult and/or expensive to collect large amounts of training images. Inspired by the success of Data Augmentation (DA) for classification problems, in this paper, we propose a pipeline for data augmentation for accelerated MRI reconstruction and study its effectiveness at reducing the required training data in a variety of settings. Our DA pipeline, MRAugment, is specifically designed to utilize the invariances present in medical imaging measurements as naive DA strategies that neglect the physics of the problem fail. Through extensive studies on multiple datasets we demonstrate that in the low-data regime DA prevents overfitting and can match or even surpass the state of the art while using significantly fewer training data, whereas in the high-data regime it has diminishing returns. Furthermore, our findings show that DA can improve the robustness of the model against various shifts in the test distribution.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
25 of 41 references.
References · 25
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2017Deep Image Priorcited by 1,097
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 361
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
- 2017Deep learning for undersampled MRI reconstructioncited by 91
- 2017Framing U-Net via Deep Convolutional Framelets: Application to Sparse-view CTcited by 87
13 more
- 2020Image Augmentations for GAN Trainingcited by 78
- 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
- 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
- 2017Smart Augmentation - Learning an Optimal Data Augmentation Strategycited by 54
- 2018Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networkscited by 53
- 2021Measuring Robustness in Deep Learning Based Compressive Sensingcited by 53
- 2017A Bayesian Data Augmentation Approach for Learning Deep Modelscited by 50
- 2018Compressed Sensing with Deep Image Prior and Learned Regularizationcited by 47
- 2020Compressive sensing with un-trained neural networks: Gradient descent finds the smoothest approximationcited by 39
- 2019Invert to Learn to Invertcited by 18
- 2018SANTIS: Sampling-Augmented Neural neTwork with Incoherent Structure for MR image reconstructioncited by 10
- 2019Adaptive-CS-Net: FastMRI with Adaptive Intelligencecited by 2
- 2020Accelerated MRI with Un-trained Neural Networkscited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 3; 2024: 6; 2025: 2; 2026: 1.
19 papers.
Sort:
By area:
- 2022Imaging with Equivariant Deep Learningcited by 35
- 2024Deep Diffusion Image Prior for Efficient OOD Adaptation in 3D Inverse Problemscited by 21
- 2021Towards Domain-Independent and Real-Time Gesture Recognition Using mmWave Signalcited by 19
- 2022Adversarial Robustness of MR Image Reconstruction under Realistic Perturbationscited by 11
- 2022To be or not to be stable, that is the question: understanding neural networks for inverse problemscited by 8
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2023The stochastic digital human is now enrolling for in silico imaging trials -- Methods and tools for generating digital cohortscited by 6
- 2022Scale-Equivariant Unrolled Neural Networks for Data-Efficient Accelerated MRI Reconstructioncited by 5
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
- 2021Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learningcited by 2
- 2024Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetrycited by 2
- 2022A Path Towards Clinical Adaptation of Accelerated MRIcited by 1
7 more
- 2024Relaxometry Guided Quantitative Cardiac Magnetic Resonance Image Reconstructioncited by 1
- 2024DTR: A Unified Deep Tensor Representation Framework for Multimedia Data Recoverycited by 1
- 2024Self-Consistent Nested Diffusion Bridge for Accelerated MRI Reconstructioncited by 1
- 2023Something for (almost) nothing: Improving deep ensemble calibration using unlabeled datacited by 0
- 2024Inference Stage Denoising for Undersampled MRI Reconstructioncited by 0
- 2025Rethinking Convergence in Deep Learning: The Predictive-Corrective Paradigm for Anatomy-Informed Brain MRI Segmentationcited by 0
- 2026PE-CSNet: An equivariant network architecture with learnable patch-based sparse representationcited by 0
- 2026PE-CSNet: An equivariant network architecture with learnable patch-based sparse representation11 Aug 2026
- 2025Rethinking Convergence in Deep Learning: The Predictive-Corrective Paradigm for Anatomy-Informed Brain MRI Segmentation17 Oct 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2024Self-Consistent Nested Diffusion Bridge for Accelerated MRI Reconstruction13 Dec 2024
- 2024Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetry12 Nov 2024
- 2024Deep Diffusion Image Prior for Efficient OOD Adaptation in 3D Inverse Problems15 Jul 2024
- 2024DTR: A Unified Deep Tensor Representation Framework for Multimedia Data Recovery7 Jul 2024
- 2024Relaxometry Guided Quantitative Cardiac Magnetic Resonance Image Reconstruction1 Mar 2024
- 2024Inference Stage Denoising for Undersampled MRI Reconstruction12 Feb 2024
- 2023Something for (almost) nothing: Improving deep ensemble calibration using unlabeled data4 Oct 2023
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methods30 May 2023
- 2023The stochastic digital human is now enrolling for in silico imaging trials -- Methods and tools for generating digital cohorts20 Jan 2023
7 more
- 2022To be or not to be stable, that is the question: understanding neural networks for inverse problems24 Nov 2022
- 2022Imaging with Equivariant Deep Learning5 Sep 2022
- 2022A Path Towards Clinical Adaptation of Accelerated MRI26 Aug 2022
- 2022Adversarial Robustness of MR Image Reconstruction under Realistic Perturbations5 Aug 2022
- 2022Scale-Equivariant Unrolled Neural Networks for Data-Efficient Accelerated MRI Reconstruction21 Apr 2022
- 2021Towards Domain-Independent and Real-Time Gesture Recognition Using mmWave Signal11 Nov 2021
- 2021Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learning30 Sep 2021
- 2022Imaging with Equivariant Deep Learningcited by 35
- 2021Towards Domain-Independent and Real-Time Gesture Recognition Using mmWave Signalcited by 19
- 2022Adversarial Robustness of MR Image Reconstruction under Realistic Perturbationscited by 11
- 2022To be or not to be stable, that is the question: understanding neural networks for inverse problemscited by 8
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2023The stochastic digital human is now enrolling for in silico imaging trials -- Methods and tools for generating digital cohortscited by 6
- 2022Scale-Equivariant Unrolled Neural Networks for Data-Efficient Accelerated MRI Reconstructioncited by 5
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
- 2021Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learningcited by 2
- 2024Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetrycited by 2
- 2022A Path Towards Clinical Adaptation of Accelerated MRIcited by 1
- 2024Relaxometry Guided Quantitative Cardiac Magnetic Resonance Image Reconstructioncited by 1
12 most cited of 17 All 17 (JSON)
- 2026PE-CSNet: An equivariant network architecture with learnable patch-based sparse representation11 Aug 2026
- 2025Rethinking Convergence in Deep Learning: The Predictive-Corrective Paradigm for Anatomy-Informed Brain MRI Segmentation17 Oct 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2024Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetry12 Nov 2024
- 2024DTR: A Unified Deep Tensor Representation Framework for Multimedia Data Recovery7 Jul 2024
- 2024Relaxometry Guided Quantitative Cardiac Magnetic Resonance Image Reconstruction1 Mar 2024
- 2024Inference Stage Denoising for Undersampled MRI Reconstruction12 Feb 2024
- 2023Something for (almost) nothing: Improving deep ensemble calibration using unlabeled data4 Oct 2023
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methods30 May 2023
- 2023The stochastic digital human is now enrolling for in silico imaging trials -- Methods and tools for generating digital cohorts20 Jan 2023
- 2022To be or not to be stable, that is the question: understanding neural networks for inverse problems24 Nov 2022
- 2022Imaging with Equivariant Deep Learning5 Sep 2022
12 newest of 17 All 17 (JSON)