# Data augmentation for deep learning based accelerated MRI reconstruction with limited data

arXiv: https://arxiv.org/abs/2106.14947 · HTML: https://mlsanity.com/paper/2106.14947/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 41 references that are in the map.
- First posted on arXiv 28 Jun 2021.

## Builds on (most cited first, 25 of 25)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [UNet++: A Nested U-Net Architecture for Medical Image Segmentation](https://mlsanity.com/paper/1807.10165/) (2018)
- [3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation](https://mlsanity.com/paper/1606.06650/) (2016)
- [Training Generative Adversarial Networks with Limited Data](https://mlsanity.com/paper/2006.06676/) (2020)
- [Deep Image Prior](https://mlsanity.com/paper/1711.10925/) (2017)
- [fastMRI: An Open Dataset and Benchmarks for Accelerated MRI](https://mlsanity.com/paper/1811.08839/) (2018)
- [Differentiable Augmentation for Data-Efficient GAN Training](https://mlsanity.com/paper/2006.10738/) (2020)
- [Deep Learning Techniques for Inverse Problems in Imaging](https://mlsanity.com/paper/2005.06001/) (2020)
- [End-to-End Variational Networks for Accelerated MRI Reconstruction](https://mlsanity.com/paper/2004.06688/) (2020)
- [Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networks](https://mlsanity.com/paper/1810.03982/) (2018)
- [Deep learning for undersampled MRI reconstruction](https://mlsanity.com/paper/1709.02576/) (2017)
- [Framing U-Net via Deep Convolutional Framelets: Application to Sparse-view CT](https://mlsanity.com/paper/1708.08333/) (2017)
- [Image Augmentations for GAN Training](https://mlsanity.com/paper/2006.02595/) (2020)
- [A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction](https://mlsanity.com/paper/1703.00555/) (2017)
- [Time-Dependent Deep Image Prior for Dynamic MRI](https://mlsanity.com/paper/1910.01684/) (2019)
- [Smart Augmentation - Learning an Optimal Data Augmentation Strategy](https://mlsanity.com/paper/1703.08383/) (2017)
- [Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networks](https://mlsanity.com/paper/1804.00432/) (2018)
- [Measuring Robustness in Deep Learning Based Compressive Sensing](https://mlsanity.com/paper/2102.06103/) (2021)
- [A Bayesian Data Augmentation Approach for Learning Deep Models](https://mlsanity.com/paper/1710.10564/) (2017)
- [Compressed Sensing with Deep Image Prior and Learned Regularization](https://mlsanity.com/paper/1806.06438/) (2018)
- [Compressive sensing with un-trained neural networks: Gradient descent finds the smoothest approximation](https://mlsanity.com/paper/2005.03991/) (2020)
- [Invert to Learn to Invert](https://mlsanity.com/paper/1911.10914/) (2019)
- [SANTIS: Sampling-Augmented Neural neTwork with Incoherent Structure for MR image reconstruction](https://mlsanity.com/paper/1812.03278/) (2018)
- [Adaptive-CS-Net: FastMRI with Adaptive Intelligence](https://mlsanity.com/paper/1912.12259/) (2019)
- [Accelerated MRI with Un-trained Neural Networks](https://mlsanity.com/paper/2007.02471/) (2020)

## Built on by (most cited first, 20 of 20)

- [Imaging with Equivariant Deep Learning](https://mlsanity.com/paper/2209.01725/) (2022)
- [Deep Diffusion Image Prior for Efficient OOD Adaptation in 3D Inverse Problems](https://mlsanity.com/paper/2407.10641/) (2024)
- [Towards Domain-Independent and Real-Time Gesture Recognition Using mmWave Signal](https://mlsanity.com/paper/2111.06195/) (2021)
- [Adversarial Robustness of MR Image Reconstruction under Realistic Perturbations](https://mlsanity.com/paper/2208.03161/) (2022)
- [To be or not to be stable, that is the question: understanding neural networks for inverse problems](https://mlsanity.com/paper/2211.13692/) (2022)
- [Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methods](https://mlsanity.com/paper/2305.19079/) (2023)
- [The stochastic digital human is now enrolling for in silico imaging trials -- Methods and tools for generating digital cohorts](https://mlsanity.com/paper/2301.08719/) (2023)
- [Scale-Equivariant Unrolled Neural Networks for Data-Efficient Accelerated MRI Reconstruction](https://mlsanity.com/paper/2204.10436/) (2022)
- [Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction](https://mlsanity.com/paper/2502.14009/) (2025)
- [Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learning](https://mlsanity.com/paper/2110.00075/) (2021)
- [Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetry](https://mlsanity.com/paper/2411.07918/) (2024)
- [A Path Towards Clinical Adaptation of Accelerated MRI](https://mlsanity.com/paper/2208.12835/) (2022)
- [Relaxometry Guided Quantitative Cardiac Magnetic Resonance Image Reconstruction](https://mlsanity.com/paper/2403.00549/) (2024)
- [DTR: A Unified Deep Tensor Representation Framework for Multimedia Data Recovery](https://mlsanity.com/paper/2407.05267/) (2024)
- [Self-Consistent Nested Diffusion Bridge for Accelerated MRI Reconstruction](https://mlsanity.com/paper/2412.09998/) (2024)
- [Something for (almost) nothing: Improving deep ensemble calibration using unlabeled data](https://mlsanity.com/paper/2310.02885/) (2023)
- [Inference Stage Denoising for Undersampled MRI Reconstruction](https://mlsanity.com/paper/2402.08692/) (2024)
- [Rethinking Convergence in Deep Learning: The Predictive-Corrective Paradigm for Anatomy-Informed Brain MRI Segmentation](https://mlsanity.com/paper/2510.15439/) (2025)
- [PE-CSNet: An equivariant network architecture with learnable patch-based sparse representation](https://mlsanity.com/paper/2608.14708/) (2026)
- [Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstruction](https://mlsanity.com/paper/2610.11560/) (2026)

## Abstract (arXiv)

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To achieve state-of-the-art performance, training on large and diverse sets of images is considered critical. However, it is often difficult and/or expensive to collect large amounts of training images. Inspired by the success of Data Augmentation (DA) for classification problems, in this paper, we propose a pipeline for data augmentation for accelerated MRI reconstruction and study its effectiveness at reducing the required training data in a variety of settings. Our DA pipeline, MRAugment, is specifically designed to utilize the invariances present in medical imaging measurements as naive DA strategies that neglect the physics of the problem fail. Through extensive studies on multiple datasets we demonstrate that in the low-data regime DA prevents overfitting and can match or even surpass the state of the art while using significantly fewer training data, whereas in the high-data regime it has diminishing returns. Furthermore, our findings show that DA can improve the robustness of the model against various shifts in the test distribution.
