mlsanityData to 14 Oct 2026

Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIs

arXiv 2310.04630 ↗First posted 7 Oct 2023eess.IV cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Generative AI models hold great potential in creating synthetic brain MRIs that advance neuroimaging studies by, for example, enriching data diversity. However, the mainstay of AI research only focuses on optimizing the visual quality (such as signal-to-noise ratio) of the synthetic MRIs while lacking insights into their relevance to neuroscience. To gain these insights with respect to T1-weighted MRIs, we first propose a new generative model, BrainSynth, to synthesize metadata-conditioned (e.g., age- and sex-specific) MRIs that achieve state-of-the-art visual quality. We then extend our evaluation with a novel procedure to quantify anatomical plausibility, i.e., how well the synthetic MRIs capture macrostructural properties of brain regions, and how accurately they encode the effects of age and sex. Results indicate that more than half of the brain regions in our synthetic MRIs are anatomically accurate, i.e., with a small effect size between real and synthetic MRIs. Moreover, the anatomical plausibility varies across cortical regions according to their geometric complexity. As is, our synthetic MRIs can significantly improve the training of a Convolutional Neural Network to identify accelerated aging effects in an independent study. These results highlight the opportunities of using generative AI to aid neuroimaging research and point to areas for further improvement.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 25 of its 53 references that are in the map. First posted on arXiv 7 Oct 2023.

Builds on

25 of 53 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2022Generative Adversarial Networkscited by 5,627
  7. 2017Neural Discrete Representation Learningcited by 4,712
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  9. 2017Improved Training of Wasserstein GANscited by 2,235
  10. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  11. 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
  12. 2022Brain Imaging Generation with Latent Diffusion Modelscited by 268
13 more
  1. 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 211
  2. 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 147
  3. 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 132
  4. 2016Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarkercited by 72
  5. 2021Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codescited by 71
  6. 2019Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networkscited by 65
  7. 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 65
  8. 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
  9. 20213D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Imagescited by 32
  10. 2020Longitudinal Self-Supervised Learningcited by 30
  11. 2022Generating Realistic Brain MRIs via a Conditional Diffusion Probabilistic Modelcited by 28
  12. 2021Metadata Normalizationcited by 14
  13. 2019Confounder-Aware Visualization of ConvNetscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 4.

12 papers.