Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networks
Not on the map. Why?
Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
As deep learning is showing unprecedented success in medical image analysis tasks, the lack of sufficient medical data is emerging as a critical problem. While recent attempts to solve the limited data problem using Generative Adversarial Networks (GAN) have been successful in generating realistic images with diversity, most of them are based on image-to-image translation and thus require extensive datasets from different domains. Here, we propose a novel model that can successfully generate 3D brain MRI data from random vectors by learning the data distribution. Our 3D GAN model solves both image blurriness and mode collapse problems by leveraging alpha-GAN that combines the advantages of Variational Auto-Encoder (VAE) and GAN with an additional code discriminator network. We also use the Wasserstein GAN with Gradient Penalty (WGAN-GP) loss to lower the training instability. To demonstrate the effectiveness of our model, we generate new images of normal brain MRI and show that our model outperforms baseline models in both quantitative and qualitative measurements. We also train the model to synthesize brain disorder MRI data to demonstrate the wide applicability of our model. Our results suggest that the proposed model can successfully generate various types and modalities of 3D whole brain volumes from a small set of training data.
Key facts. Cited by 65 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 14; 2023: 14; 2024: 8; 2025: 17; 2026: 8.
65 papers.
Sort:
By area:
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 268
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 86
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesiscited by 56
- 2022Medical Diffusion: Denoising Diffusion Probabilistic Models for 3D Medical Image Generationcited by 54
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Reviewcited by 48
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generationcited by 34
- 20213D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Imagescited by 32
- 2022Generating Realistic Brain MRIs via a Conditional Diffusion Probabilistic Modelcited by 28
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2022Morphology-preserving Autoregressive 3D Generative Modelling of the Braincited by 15
- 2022Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Frameworkcited by 14
38 more
- 2024Generative Enhancement for 3D Medical Imagescited by 14
- 2024Deep Generative Models for 3D Medical Image Synthesiscited by 14
- 2022FakeNews: GAN-based generation of realistic 3D volumetric data -- A systematic review and taxonomycited by 13
- 2023Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIscited by 12
- 2022Brain Lesion Synthesis via Progressive Adversarial Variational Auto-Encodercited by 8
- 2022Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Imagescited by 8
- 2023Multiscale Metamorphic VAE for 3D Brain MRI Synthesiscited by 8
- 2022Cross-Modality Neuroimage Synthesis: A Surveycited by 7
- 2022Pathology Synthesis of 3D-Consistent Cardiac MR Images using 2D VAEs and GANscited by 7
- 2024Latent Causal Modeling for 3D Brain MRI Counterfactualscited by 7
- 2023Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networkscited by 6
- 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculaturecited by 5
- 2025WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIscited by 5
- 20223D Brain and Heart Volume Generative Models: A Surveycited by 4
- 2023Deep Generative Networks for Heterogeneous Augmentation of Cranial Defectscited by 4
- 2024DP-MDM: Detail-Preserving MR Reconstruction via Multiple Diffusion Modelscited by 4
- 2025BrainMRDiff: A Diffusion Model for Anatomically Consistent Brain MRI Synthesiscited by 4
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive reviewcited by 3
- 2024Devil is in Details: Locality-Aware 3D Abdominal CT Volume Generation for Self-Supervised Organ Segmentationcited by 3
- 2022Improved α-GAN architecture for generating 3D connected volumes with an application to radiosurgery treatment planningcited by 2
- 2023Unpaired Translation from Semantic Label Maps to Images by Leveraging Domain-Specific Simulationscited by 2
- 2023Learning Sequential Information in Task-based fMRI for Synthetic Data Augmentationcited by 2
- 2025Towards Better Cephalometric Landmark Detection with Diffusion Data Generationcited by 2
- 2025From 2D to 3D, Deep Learning-based Shape Reconstruction in Magnetic Resonance Imaging: A Reviewcited by 2
- 2025Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generationcited by 2
- 2026Anatomically Guided Latent Diffusion for Brain MRI Progression Modelingcited by 2
- 2026Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generationcited by 2
- 2021Latent Space Analysis of VAE and Intro-VAE applied to 3-dimensional MR Brain Volumes of Multiple Sclerosis, Leukoencephalopathy, and Healthy Patientscited by 1
- 2021Data Augmentation For Medical MR Image Using Generative Adversarial Networkscited by 1
- 2022'A net for everyone': fully personalized and unsupervised neural networks trained with longitudinal data from a single patientcited by 1
- 2023Method for Generating Synthetic Data Combining Chest Radiography Images with Tabular Clinical Information Using Dual Generative Modelscited by 1
- 2023A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancycited by 1
- 2025PRO: Projection Domain Synthesis for CT Imagingcited by 1
- 2025Integrating Anatomical Priors into a Causal Diffusion Modelcited by 1
- 2025Cycle Diffusion Model for Counterfactual Image Generationcited by 1
- 2026Optimizing 3D Diffusion Models for Medical Imaging via Multi-Scale Reward Learningcited by 1
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRIcited by 1
- 2021Generation of Synthetic Rat Brain MRI scans with a 3D Enhanced Alpha-GANcited by 0
50 most cited of 65 All 65 (JSON)
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation24 Aug 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologies9 Jul 2026
- 2026Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation18 Jun 2026
- 2026Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis13 Jun 2026
- 2026Optimizing 3D Diffusion Models for Medical Imaging via Multi-Scale Reward Learning6 Mar 2026
- 2026Anatomically Guided Latent Diffusion for Brain MRI Progression Modeling21 Jan 2026
- 2025The Age-specific Alzheimer 's Disease Prediction with Characteristic Constraints in Nonuniform Time Span26 Nov 2025
- 2025Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generation25 Oct 2025
- 2025From 2D to 3D, Deep Learning-based Shape Reconstruction in Magnetic Resonance Imaging: A Review1 Oct 2025
- 2025Cycle Diffusion Model for Counterfactual Image Generation29 Sep 2025
38 more
- 2025Integrating Anatomical Priors into a Causal Diffusion Model10 Sep 2025
- 2025MRExtrap: Longitudinal Aging of Brain MRIs using Linear Modeling in Latent Space26 Aug 2025
- 2025Prompt Mechanisms in Medical Imaging: A Comprehensive Survey28 Jun 2025
- 2025PRO: Projection Domain Synthesis for CT Imaging16 Jun 2025
- 2025Towards Better Cephalometric Landmark Detection with Diffusion Data Generation9 May 2025
- 2025WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIs30 Apr 2025
- 2025Deep Generative Model-Based Generation of Synthetic Individual-Specific Brain MRI Segmentations15 Apr 2025
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models15 Apr 2025
- 2025BrainMRDiff: A Diffusion Model for Anatomically Consistent Brain MRI Synthesis6 Apr 2025
- 2025Memory-Efficient 3D High-Resolution Medical Image Synthesis Using CRF-Guided GANs13 Mar 2025
- 2025A Deep Bayesian Nonparametric Framework for Robust Mutual Information Estimation11 Mar 2025
- 2025Generating Novel Brain Morphology by Deforming Learned Templates4 Mar 2025
- 2025Comparative clinical evaluation of "memory-efficient" synthetic 3d generative adversarial networks (gan) head-to-head to state of art: results on computed tomography of the chest26 Jan 2025
- 2024Deep Generative Models for 3D Medical Image Synthesis23 Oct 2024
- 2024Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation16 Oct 2024
- 2024Devil is in Details: Locality-Aware 3D Abdominal CT Volume Generation for Self-Supervised Organ Segmentation30 Sep 2024
- 2024Latent Causal Modeling for 3D Brain MRI Counterfactuals9 Sep 2024
- 2024Applications of interpretable deep learning in neuroimaging: a comprehensive review30 May 2024
- 2024DP-MDM: Detail-Preserving MR Reconstruction via Multiple Diffusion Models9 May 2024
- 2024Generative Enhancement for 3D Medical Images19 Mar 2024
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis29 Feb 2024
- 2023Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIs7 Oct 2023
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Images5 Oct 2023
- 2023Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks2 Oct 2023
- 2023Learning Sequential Information in Task-based fMRI for Synthetic Data Augmentation29 Aug 2023
- 2023A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancy27 Aug 2023
- 2023Method for Generating Synthetic Data Combining Chest Radiography Images with Tabular Clinical Information Using Dual Generative Models15 Aug 2023
- 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculature13 Aug 2023
- 2023Deep Generative Networks for Heterogeneous Augmentation of Cranial Defects9 Aug 2023
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review24 Jul 2023
- 2023Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification2 Jul 2023
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis29 May 2023
- 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generation8 Apr 2023
- 2023Unpaired Translation from Semantic Label Maps to Images by Leveraging Domain-Specific Simulations21 Feb 2023
- 2023Multiscale Metamorphic VAE for 3D Brain MRI Synthesis9 Jan 2023
- 2022Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Framework20 Dec 2022
- 2022Generating Realistic Brain MRIs via a Conditional Diffusion Probabilistic Model15 Dec 2022
- 2022Medical Diffusion: Denoising Diffusion Probabilistic Models for 3D Medical Image Generation7 Nov 2022
50 newest of 65 All 65 (JSON)
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 268
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 86
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesiscited by 56
- 2022Medical Diffusion: Denoising Diffusion Probabilistic Models for 3D Medical Image Generationcited by 54
- 2022Generating Realistic Brain MRIs via a Conditional Diffusion Probabilistic Modelcited by 28
- 2024Generative Enhancement for 3D Medical Imagescited by 14
- 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculaturecited by 5
- 2024DP-MDM: Detail-Preserving MR Reconstruction via Multiple Diffusion Modelscited by 4
- 2025BrainMRDiff: A Diffusion Model for Anatomically Consistent Brain MRI Synthesiscited by 4
- 2026Anatomically Guided Latent Diffusion for Brain MRI Progression Modelingcited by 2
- 2026Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generationcited by 2
- 2025Integrating Anatomical Priors into a Causal Diffusion Modelcited by 1
12 most cited of 20 All 20 (JSON)
- 2026AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation24 Aug 2026
- 2026TCAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model15 Jul 2026
- 2026Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation18 Jun 2026
- 2026Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis13 Jun 2026
- 2026Optimizing 3D Diffusion Models for Medical Imaging via Multi-Scale Reward Learning6 Mar 2026
- 2026Anatomically Guided Latent Diffusion for Brain MRI Progression Modeling21 Jan 2026
- 2025Cycle Diffusion Model for Counterfactual Image Generation29 Sep 2025
- 2025Integrating Anatomical Priors into a Causal Diffusion Model10 Sep 2025
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models15 Apr 2025
- 2025BrainMRDiff: A Diffusion Model for Anatomically Consistent Brain MRI Synthesis6 Apr 2025
- 2025Generating Novel Brain Morphology by Deforming Learned Templates4 Mar 2025
- 2024Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation16 Oct 2024
12 newest of 20 All 20 (JSON)
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Reviewcited by 48
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generationcited by 34
- 20213D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Imagescited by 32
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2022Morphology-preserving Autoregressive 3D Generative Modelling of the Braincited by 15
- 2022Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Frameworkcited by 14
- 2024Deep Generative Models for 3D Medical Image Synthesiscited by 14
- 2022FakeNews: GAN-based generation of realistic 3D volumetric data -- A systematic review and taxonomycited by 13
- 2023Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIscited by 12
- 2022Brain Lesion Synthesis via Progressive Adversarial Variational Auto-Encodercited by 8
- 2022Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Imagescited by 8
12 most cited of 45 All 45 (JSON)
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologies9 Jul 2026
- 2025The Age-specific Alzheimer 's Disease Prediction with Characteristic Constraints in Nonuniform Time Span26 Nov 2025
- 2025Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generation25 Oct 2025
- 2025From 2D to 3D, Deep Learning-based Shape Reconstruction in Magnetic Resonance Imaging: A Review1 Oct 2025
- 2025MRExtrap: Longitudinal Aging of Brain MRIs using Linear Modeling in Latent Space26 Aug 2025
- 2025Prompt Mechanisms in Medical Imaging: A Comprehensive Survey28 Jun 2025
- 2025PRO: Projection Domain Synthesis for CT Imaging16 Jun 2025
- 2025Towards Better Cephalometric Landmark Detection with Diffusion Data Generation9 May 2025
- 2025WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIs30 Apr 2025
- 2025Deep Generative Model-Based Generation of Synthetic Individual-Specific Brain MRI Segmentations15 Apr 2025
- 2025Memory-Efficient 3D High-Resolution Medical Image Synthesis Using CRF-Guided GANs13 Mar 2025
12 newest of 45 All 45 (JSON)