# Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review

arXiv: https://arxiv.org/abs/2307.13125 · HTML: https://mlsanity.com/paper/2307.13125/

## Key facts

- Cited by 48 papers in the map (data through 14 Oct 2026).
- Builds on 95 of its 164 references that are in the map.
- First posted on arXiv 24 Jul 2023.

## Builds on (most cited first, 30 of 95)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Denoising Diffusion Implicit Models](https://mlsanity.com/paper/2010.02502/) (2020)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)
- [Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding](https://mlsanity.com/paper/2205.11487/) (2022)
- [Generative Adversarial Networks](https://mlsanity.com/paper/2203.00667/) (2022)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Zero-Shot Text-to-Image Generation](https://mlsanity.com/paper/2102.12092/) (2021)
- [Auto-Encoding Variational Bayes](https://mlsanity.com/paper/1312.6114/) (2013)
- [Progressive Growing of GANs for Improved Quality, Stability, and Variation](https://mlsanity.com/paper/1710.10196/) (2017)
- [Improved Techniques for Training GANs](https://mlsanity.com/paper/1606.03498/) (2016)
- [Improved Training of Wasserstein GANs](https://mlsanity.com/paper/1704.00028/) (2017)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks](https://mlsanity.com/paper/1511.06434/) (2015)
- [Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network](https://mlsanity.com/paper/1609.04802/) (2016)
- [Generating Diverse High-Fidelity Images with VQ-VAE-2](https://mlsanity.com/paper/1906.00446/) (2019)
- [Semantic Image Synthesis with Spatially-Adaptive Normalization](https://mlsanity.com/paper/1903.07291/) (2019)
- [Least Squares Generative Adversarial Networks](https://mlsanity.com/paper/1611.04076/) (2016)
- [ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases](https://mlsanity.com/paper/1705.02315/) (2017)
- [Improved Precision and Recall Metric for Assessing Generative Models](https://mlsanity.com/paper/1904.06991/) (2019)
- [Which Training Methods for GANs do actually Converge?](https://mlsanity.com/paper/1801.04406/) (2018)
- [Improving Variational Inference with Inverse Autoregressive Flow](https://mlsanity.com/paper/1606.04934/) (2016)
- [Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations](https://mlsanity.com/paper/1707.03237/) (2017)
- [MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographs](https://mlsanity.com/paper/1901.07042/) (2019)
- [Conditional Image Synthesis With Auxiliary Classifier GANs](https://mlsanity.com/paper/1610.09585/) (2016)

## Built on by (most cited first, 30 of 48)

- [Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challenges](https://mlsanity.com/paper/2407.00116/) (2024)
- [Similarity and Quality Metrics for MR Image-To-Image Translation](https://mlsanity.com/paper/2405.08431/) (2024)
- [Metrics that matter: Evaluating image quality metrics for medical image generation](https://mlsanity.com/paper/2505.07175/) (2025)
- [PairAug: What Can Augmented Image-Text Pairs Do for Radiology?](https://mlsanity.com/paper/2404.04960/) (2024)
- [Diffusion as Sound Propagation: Physics-inspired Model for Ultrasound Image Generation](https://mlsanity.com/paper/2407.05428/) (2024)
- [Revisiting Data Augmentation for Ultrasound Images](https://mlsanity.com/paper/2501.13193/) (2025)
- [3D MRI Synthesis with Slice-Based Latent Diffusion Models: Improving Tumor Segmentation Tasks in Data-Scarce Regimes](https://mlsanity.com/paper/2406.05421/) (2024)
- [AMM-Diff: Adaptive Multi-Modality Diffusion Network for Missing Modality Imputation](https://mlsanity.com/paper/2501.12840/) (2025)
- [RL4Med-DDPO: Reinforcement Learning for Controlled Guidance Towards Diverse Medical Image Generation using Vision-Language Foundation Models](https://mlsanity.com/paper/2503.15784/) (2025)
- [A Unified Framework for Generative Data Augmentation: A Comprehensive Survey](https://mlsanity.com/paper/2310.00277/) (2023)
- [Analyzing Data Augmentation for Medical Images: A Case Study in Ultrasound Images](https://mlsanity.com/paper/2403.09828/) (2024)
- [Empowering Healthcare through Privacy-Preserving MRI Analysis](https://mlsanity.com/paper/2403.09836/) (2024)
- [4CNet: A Diffusion Approach to Map Prediction for Decentralized Multi-Robot Exploration](https://mlsanity.com/paper/2402.17904/) (2024)
- [Discriminative Hamiltonian Variational Autoencoder for Accurate Tumor Segmentation in Data-Scarce Regimes](https://mlsanity.com/paper/2406.11659/) (2024)
- [Synthetic Tumor Manipulation: With Radiomics Features](https://mlsanity.com/paper/2311.02586/) (2023)
- [End-to-end autoencoding architecture for the simultaneous generation of medical images and corresponding segmentation masks](https://mlsanity.com/paper/2311.10472/) (2023)
- [Addressing Small and Imbalanced Medical Image Datasets Using Generative Models: A Comparative Study of DDPM and PGGANs with Random and Greedy K Sampling](https://mlsanity.com/paper/2412.12532/) (2024)
- [Perceive and Calibrate: Analyzing and Enhancing Robustness of Medical Multi-Modal Large Language Models](https://mlsanity.com/paper/2512.21964/) (2025)
- [Repeat and Concatenate: 2D to 3D Image Translation with 3D to 3D Generative Modeling](https://mlsanity.com/paper/2406.18422/) (2024)
- [Robust and Explainable Framework to Address Data Scarcity in Diagnostic Imaging](https://mlsanity.com/paper/2407.06566/) (2024)
- [Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification](https://mlsanity.com/paper/2409.16002/) (2024)
- [Synthetic Generation of Dermatoscopic Images with GAN and Closed-Form Factorization](https://mlsanity.com/paper/2410.05114/) (2024)
- [Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generation](https://mlsanity.com/paper/2503.24258/) (2025)
- [Inpainting is All You Need: A Diffusion-based Augmentation Method for Semi-supervised Medical Image Segmentation](https://mlsanity.com/paper/2506.23038/) (2025)
- [Recent Advancements in Microscopy Image Enhancement using Deep Learning: A Survey](https://mlsanity.com/paper/2509.15363/) (2025)
- [AI-Augmented Pollen Recognition in Optical and Holographic Microscopy for Veterinary Imaging](https://mlsanity.com/paper/2512.12101/) (2025)
- [Advancing Generative Model Evaluation: A Novel Algorithm for Realistic Image Synthesis and Comparison in OCR System](https://mlsanity.com/paper/2402.17204/) (2024)
- [Could We Generate Cytology Images from Histopathology Images? An Empirical Study](https://mlsanity.com/paper/2403.10885/) (2024)
- [Accelerated Proton Resonance Frequency-based Magnetic Resonance Thermometry by Optimized Deep Learning Method](https://mlsanity.com/paper/2407.03308/) (2024)
- [Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation](https://mlsanity.com/paper/2410.12542/) (2024)

## Abstract (arXiv)

Deep learning has become a popular tool for medical image analysis, but the limited availability of training data remains a major challenge, particularly in the medical field where data acquisition can be costly and subject to privacy regulations. Data augmentation techniques offer a solution by artificially increasing the number of training samples, but these techniques often produce limited and unconvincing results. To address this issue, a growing number of studies have proposed the use of deep generative models to generate more realistic and diverse data that conform to the true distribution of the data. In this review, we focus on three types of deep generative models for medical image augmentation: variational autoencoders, generative adversarial networks, and diffusion models. We provide an overview of the current state of the art in each of these models and discuss their potential for use in different downstream tasks in medical imaging, including classification, segmentation, and cross-modal translation. We also evaluate the strengths and limitations of each model and suggest directions for future research in this field. Our goal is to provide a comprehensive review about the use of deep generative models for medical image augmentation and to highlight the potential of these models for improving the performance of deep learning algorithms in medical image analysis.