Medical Diffusion: Denoising Diffusion Probabilistic Models for 3D Medical Image Generation
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models in particular have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen and Stable Diffusion. However, their use in medicine, where image data typically comprises three-dimensional volumes, has not been systematically evaluated. Synthetic images may play a crucial role in privacy preserving artificial intelligence and can also be used to augment small datasets. Here we show that diffusion probabilistic models can synthesize high quality medical imaging data, which we show for Magnetic Resonance Images (MRI) and Computed Tomography (CT) images. We provide quantitative measurements of their performance through a reader study with two medical experts who rated the quality of the synthesized images in three categories: Realistic image appearance, anatomical correctness and consistency between slices. Furthermore, we demonstrate that synthetic images can be used in a self-supervised pre-training and improve the performance of breast segmentation models when data is scarce (dice score 0.91 vs. 0.95 without vs. with synthetic data). The code is publicly available on GitHub: https://github.com/FirasGit/medicaldiffusion.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 16 of its 35 references that are in the map. First posted on arXiv 7 Nov 2022.
Builds on
16 of 35 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2022Video Diffusion Modelscited by 2,280
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2019Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networkscited by 65
3 more
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2019Synthesizing Diverse Lung Nodules Wherever Massively: 3D Multi-Conditional GAN-based CT Image Augmentation for Object Detectioncited by 29
- 20213D fluorescence microscopy data synthesis for segmentation and benchmarkingcited by 8
Built on by
Citing papers per year: 2022: 1; 2023: 18; 2024: 18; 2025: 11; 2026: 6.
54 papers.
Sort:
By area:
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 225
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Reviewcited by 48
- 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesiscited by 43
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2023Memory-Efficient 3D Denoising Diffusion Models for Medical Image Processingcited by 30
- 2024Denoising Diffusion Models for 3D Healthy Brain Tissue Inpaintingcited by 22
- 2023Medical diffusion on a budget: Textual Inversion for medical image generationcited by 20
- 2024FairDiff: Fair Segmentation with Point-Image Diffusioncited by 15
38 more
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedbackcited by 14
- 2023Synthesising Rare Cataract Surgery Samples with Guided Diffusion Modelscited by 14
- 2024Generative Enhancement for 3D Medical Imagescited by 14
- 2023Denoising Diffusion Probabilistic Models for Generation of Realistic Fully-Annotated Microscopy Image Data Setscited by 13
- 2024HiDiff: Hybrid Diffusion Framework for Medical Image Segmentationcited by 13
- 2024Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learningcited by 10
- 2023A Survey of Emerging Applications of Diffusion Probabilistic Models in MRIcited by 9
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlasescited by 8
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Modelscited by 8
- 2023Efficiently Training Vision Transformers on Structural MRI Scans for Alzheimer's Disease Detectioncited by 7
- 2023Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networkscited by 6
- 2024Vision-Language Synthetic Data Enhances Echocardiography Downstream Taskscited by 6
- 2023Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentationcited by 5
- 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculaturecited by 5
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Modelscited by 5
- 2026FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matchingcited by 5
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotationcited by 4
- 2024Brain Tumour Removing and Missing Modality Generation using 3D WDMcited by 4
- 2024FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbationcited by 4
- 2025ItDPDM: Information-Theoretic Discrete Poisson Diffusion Modelcited by 4
- 2024METR: Image Watermarking with Large Number of Unique Messagescited by 3
- 2024Introducing SDICE: An Index for Assessing Diversity of Synthetic Medical Datasetscited by 3
- 2025DVG-Diffusion: Dual-View Guided Diffusion Model for CT Reconstruction from X-Rayscited by 3
- 2024MEDDAP: Medical Dataset Enhancement via Diversified Augmentation Pipelinecited by 2
- 2024Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Modelscited by 2
- 2024X-ray2CTPA: Leveraging Diffusion Models to Enhance Pulmonary Embolism Classificationcited by 2
- 2025VAP-Diffusion: Enriching Descriptions with MLLMs for Enhanced Medical Image Generationcited by 2
- 2023Video and Synthetic MRI Pre-training of 3D Vision Architectures for Neuroimage Analysiscited by 1
- 2023Non-Visible Light Data Synthesis and Application: A Case Study for Synthetic Aperture Radar Imagerycited by 1
- 2025Layer Separation: Adjustable Joint Space Width Images Synthesis in Conventional Radiographycited by 1
- 2025Shifts in Doctors' Eye Movements Between Real and AI-Generated Medical Imagescited by 1
- 2025Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Reviewcited by 1
- 2025Point-Based Shape Representation Generation with a Correspondence-Preserving Diffusion Modelcited by 1
- 2026See and Fix the Flaws: Enabling VLMs and Diffusion Models to Comprehend Visual Artifacts via Agentic Data Synthesiscited by 1
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesiscited by 1
- 2024GaNDLF-Synth: A Framework to Democratize Generative AI for (Bio)Medical Imagingcited by 0
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion modelscited by 0
- 2025Towards Application Aligned Synthetic Surgical Image Synthesiscited by 0
50 most cited of 54 All 54 (JSON)
- 2026Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models24 Sep 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis7 Jun 2026
- 2026See and Fix the Flaws: Enabling VLMs and Diffusion Models to Comprehend Visual Artifacts via Agentic Data Synthesis24 Feb 2026
- 2026POWDR: Pathology-preserving Outpainting with Wavelet Diffusion for 3D MRI14 Jan 2026
- 2026FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matching8 Jan 2026
- 2025Denoising Diffusion as a New Framework for Underwater Images11 Oct 2025
- 2025Towards Application Aligned Synthetic Surgical Image Synthesis23 Sep 2025
- 2025Point-Based Shape Representation Generation with a Correspondence-Preserving Diffusion Model5 Aug 2025
- 2025VAP-Diffusion: Enriching Descriptions with MLLMs for Enhanced Medical Image Generation30 Jun 2025
- 2025Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Review9 May 2025
- 2025ItDPDM: Information-Theoretic Discrete Poisson Diffusion Model8 May 2025
38 more
- 2025Shifts in Doctors' Eye Movements Between Real and AI-Generated Medical Images21 Apr 2025
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models15 Apr 2025
- 2025DVG-Diffusion: Dual-View Guided Diffusion Model for CT Reconstruction from X-Rays22 Mar 2025
- 2025Layer Separation: Adjustable Joint Space Width Images Synthesis in Conventional Radiography4 Feb 2025
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps16 Jan 2025
- 2024FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbation29 Dec 2024
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation17 Dec 2024
- 2024Brain Tumour Removing and Missing Modality Generation using 3D WDM7 Nov 2024
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Models10 Oct 2024
- 2024GaNDLF-Synth: A Framework to Democratize Generative AI for (Bio)Medical Imaging30 Sep 2024
- 2024Introducing SDICE: An Index for Assessing Diversity of Synthetic Medical Datasets28 Sep 2024
- 2024METR: Image Watermarking with Large Number of Unique Messages15 Aug 2024
- 2024FairDiff: Fair Segmentation with Point-Image Diffusion8 Jul 2024
- 2024HiDiff: Hybrid Diffusion Framework for Medical Image Segmentation3 Jul 2024
- 2024X-ray2CTPA: Leveraging Diffusion Models to Enhance Pulmonary Embolism Classification23 Jun 2024
- 2024A Comprehensive Survey of Foundation Models in Medicine15 Jun 2024
- 2024Vision-Language Synthetic Data Enhances Echocardiography Downstream Tasks28 Mar 2024
- 2024Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models26 Mar 2024
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlases25 Mar 2024
- 2024MEDDAP: Medical Dataset Enhancement via Diversified Augmentation Pipeline25 Mar 2024
- 2024Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting21 Mar 2024
- 2024Generative Enhancement for 3D Medical Images19 Mar 2024
- 2024Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learning11 Mar 2024
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotation1 Dec 2023
- 2023Non-Visible Light Data Synthesis and Application: A Case Study for Synthetic Aperture Radar Imagery29 Nov 2023
- 2023A Survey of Emerging Applications of Diffusion Probabilistic Models in MRI19 Nov 2023
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Images5 Oct 2023
- 2023Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks2 Oct 2023
- 2023Video and Synthetic MRI Pre-training of 3D Vision Architectures for Neuroimage Analysis9 Sep 2023
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Models30 Aug 2023
- 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculature13 Aug 2023
- 2023Synthesising Rare Cataract Surgery Samples with Guided Diffusion Models3 Aug 2023
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review24 Jul 2023
- 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis19 Jul 2023
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback16 Jun 2023
- 2023Generative models improve fairness of medical classifiers under distribution shifts18 Apr 2023
- 2023Memory-Efficient 3D Denoising Diffusion Models for Medical Image Processing27 Mar 2023
- 2023Medical diffusion on a budget: Textual Inversion for medical image generation23 Mar 2023
50 newest of 54 All 54 (JSON)
- 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesiscited by 43
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2023Memory-Efficient 3D Denoising Diffusion Models for Medical Image Processingcited by 30
- 2024Denoising Diffusion Models for 3D Healthy Brain Tissue Inpaintingcited by 22
- 2023Medical diffusion on a budget: Textual Inversion for medical image generationcited by 20
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedbackcited by 14
- 2023Synthesising Rare Cataract Surgery Samples with Guided Diffusion Modelscited by 14
- 2024Generative Enhancement for 3D Medical Imagescited by 14
- 2023Denoising Diffusion Probabilistic Models for Generation of Realistic Fully-Annotated Microscopy Image Data Setscited by 13
- 2024HiDiff: Hybrid Diffusion Framework for Medical Image Segmentationcited by 13
- 2024Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learningcited by 10
- 2023A Survey of Emerging Applications of Diffusion Probabilistic Models in MRIcited by 9
12 most cited of 34 All 34 (JSON)
- 2026Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models24 Sep 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis7 Jun 2026
- 2026See and Fix the Flaws: Enabling VLMs and Diffusion Models to Comprehend Visual Artifacts via Agentic Data Synthesis24 Feb 2026
- 2026POWDR: Pathology-preserving Outpainting with Wavelet Diffusion for 3D MRI14 Jan 2026
- 2026FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matching8 Jan 2026
- 2025Denoising Diffusion as a New Framework for Underwater Images11 Oct 2025
- 2025Towards Application Aligned Synthetic Surgical Image Synthesis23 Sep 2025
- 2025Point-Based Shape Representation Generation with a Correspondence-Preserving Diffusion Model5 Aug 2025
- 2025Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Review9 May 2025
- 2025ItDPDM: Information-Theoretic Discrete Poisson Diffusion Model8 May 2025
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models15 Apr 2025
12 newest of 34 All 34 (JSON)
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Reviewcited by 48
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 2024FairDiff: Fair Segmentation with Point-Image Diffusioncited by 15
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlasescited by 8
- 2023Efficiently Training Vision Transformers on Structural MRI Scans for Alzheimer's Disease Detectioncited by 7
- 2023Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networkscited by 6
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotationcited by 4
- 2024Brain Tumour Removing and Missing Modality Generation using 3D WDMcited by 4
- 2024Introducing SDICE: An Index for Assessing Diversity of Synthetic Medical Datasetscited by 3
- 2024MEDDAP: Medical Dataset Enhancement via Diversified Augmentation Pipelinecited by 2
12 most cited of 17 All 17 (JSON)
- 2025VAP-Diffusion: Enriching Descriptions with MLLMs for Enhanced Medical Image Generation30 Jun 2025
- 2025Shifts in Doctors' Eye Movements Between Real and AI-Generated Medical Images21 Apr 2025
- 2025Layer Separation: Adjustable Joint Space Width Images Synthesis in Conventional Radiography4 Feb 2025
- 2024Brain Tumour Removing and Missing Modality Generation using 3D WDM7 Nov 2024
- 2024GaNDLF-Synth: A Framework to Democratize Generative AI for (Bio)Medical Imaging30 Sep 2024
- 2024Introducing SDICE: An Index for Assessing Diversity of Synthetic Medical Datasets28 Sep 2024
- 2024FairDiff: Fair Segmentation with Point-Image Diffusion8 Jul 2024
- 2024A Comprehensive Survey of Foundation Models in Medicine15 Jun 2024
- 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlases25 Mar 2024
- 2024MEDDAP: Medical Dataset Enhancement via Diversified Augmentation Pipeline25 Mar 2024
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotation1 Dec 2023
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Images5 Oct 2023
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey
- 2022Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models
- 2024Multi-Conditioned Denoising Diffusion Probabilistic Model (mDDPM) for Medical Image Synthesis
- 2024Diffusion-Based Approaches in Medical Image Generation and Analysis
- 2024Analysing Diffusion Segmentation for Medical Images
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model
- 2023MAM-E: Mammographic synthetic image generation with diffusion models
- 2024Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation