3D Brain and Heart Volume Generative Models: A Survey
Not on the map. Why?
Abstract (arXiv)
Generative models such as generative adversarial networks and autoencoders have gained a great deal of attention in the medical field due to their excellent data generation capability. This paper provides a comprehensive survey of generative models for three-dimensional (3D) volumes, focusing on the brain and heart. A new and elaborate taxonomy of unconditional and conditional generative models is proposed to cover diverse medical tasks for the brain and heart: unconditional synthesis, classification, conditional synthesis, segmentation, denoising, detection, and registration. We provide relevant background, examine each task and also suggest potential future directions. A list of the latest publications will be updated on Github to keep up with the rapid influx of papers at https://github.com/csyanbin/3D-Medical-Generative-Survey.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 118 of its 261 references that are in the map. First posted on arXiv 12 Oct 2022.
Builds on
118 of 261 references.
References · 118
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Mask R-CNNcited by 7,277
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
38 more
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2016Improved Techniques for Training GANscited by 2,970
- 2015Fast R-CNNcited by 2,933
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2014Conditional Generative Adversarial Netscited by 2,162
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2015Spatial Transformer Networkscited by 1,429
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2016Pixel Recurrent Neural Networkscited by 816
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
- 2017Dynamic Routing Between Capsulescited by 689
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
- 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 328
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
- 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
- 2014Efficient Object Localization Using Convolutional Networkscited by 227
- 2018Pros and Cons of GAN Evaluation Measurescited by 224
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
50 most cited of 118 All 118 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 0; 2025: 1; 2026: 1.
4 papers.
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 273
- 2025TRACE: Temporally Reliable Anatomically-Conditioned 3D CT Generation with Enhanced Efficiencycited by 8
- 2023fRegGAN with K-space Loss Regularization for Medical Image Translationcited by 3
- 2026Knowledge-Guided 3D CT Generation: A Conditioning-Centric Taxonomycited by 1
- 2026Knowledge-Guided 3D CT Generation: A Conditioning-Centric Taxonomy7 Aug 2026
- 2025TRACE: Temporally Reliable Anatomically-Conditioned 3D CT Generation with Enhanced Efficiency1 Jul 2025
- 2023fRegGAN with K-space Loss Regularization for Medical Image Translation28 Mar 2023
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov 2022