Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIs
Not on the map. Why?
Abstract (arXiv)
Generative AI models hold great potential in creating synthetic brain MRIs that advance neuroimaging studies by, for example, enriching data diversity. However, the mainstay of AI research only focuses on optimizing the visual quality (such as signal-to-noise ratio) of the synthetic MRIs while lacking insights into their relevance to neuroscience. To gain these insights with respect to T1-weighted MRIs, we first propose a new generative model, BrainSynth, to synthesize metadata-conditioned (e.g., age- and sex-specific) MRIs that achieve state-of-the-art visual quality. We then extend our evaluation with a novel procedure to quantify anatomical plausibility, i.e., how well the synthetic MRIs capture macrostructural properties of brain regions, and how accurately they encode the effects of age and sex. Results indicate that more than half of the brain regions in our synthetic MRIs are anatomically accurate, i.e., with a small effect size between real and synthetic MRIs. Moreover, the anatomical plausibility varies across cortical regions according to their geometric complexity. As is, our synthetic MRIs can significantly improve the training of a Convolutional Neural Network to identify accelerated aging effects in an independent study. These results highlight the opportunities of using generative AI to aid neuroimaging research and point to areas for further improvement.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 25 of its 53 references that are in the map. First posted on arXiv 7 Oct 2023.
Builds on
25 of 53 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 268
13 more
- 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 211
- 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 147
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 132
- 2016Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarkercited by 72
- 2021Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codescited by 71
- 2019Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networkscited by 65
- 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 65
- 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
- 20213D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Imagescited by 32
- 2020Longitudinal Self-Supervised Learningcited by 30
- 2022Generating Realistic Brain MRIs via a Conditional Diffusion Probabilistic Modelcited by 28
- 2021Metadata Normalizationcited by 14
- 2019Confounder-Aware Visualization of ConvNetscited by 7
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 4.
12 papers.
- 2024LeFusion: Controllable Pathology Synthesis via Lesion-Focused Diffusion Modelscited by 15
- 2024Box It to Bind It: Unified Layout Control and Attribute Binding in T2I Diffusion Modelscited by 9
- 2024Latent Causal Modeling for 3D Brain MRI Counterfactualscited by 7
- 2025WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIscited by 5
- 2025Evaluation of 3D Counterfactual Brain MRI Generationcited by 2
- 2026Anatomically Guided Latent Diffusion for Brain MRI Progression Modelingcited by 2
- 2025Integrating Anatomical Priors into a Causal Diffusion Modelcited by 1
- 2025Cycle Diffusion Model for Counterfactual Image Generationcited by 1
- 2026Cortex-Grounded Diffusion Models for Brain Image Generationcited by 1
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRIcited by 1
- 2025Generating Novel Brain Morphology by Deforming Learned Templatescited by 0
- 2026Modality-Aware and Anatomical Vector-Quantized Autoencoding for Multimodal Brain MRIcited by 0
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026Modality-Aware and Anatomical Vector-Quantized Autoencoding for Multimodal Brain MRI6 Apr 2026
- 2026Cortex-Grounded Diffusion Models for Brain Image Generation27 Jan 2026
- 2026Anatomically Guided Latent Diffusion for Brain MRI Progression Modeling21 Jan 2026
- 2025Cycle Diffusion Model for Counterfactual Image Generation29 Sep 2025
- 2025Integrating Anatomical Priors into a Causal Diffusion Model10 Sep 2025
- 2025Evaluation of 3D Counterfactual Brain MRI Generation4 Aug 2025
- 2025WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIs30 Apr 2025
- 2025Generating Novel Brain Morphology by Deforming Learned Templates4 Mar 2025
- 2024Latent Causal Modeling for 3D Brain MRI Counterfactuals9 Sep 2024
- 2024LeFusion: Controllable Pathology Synthesis via Lesion-Focused Diffusion Models21 Mar 2024
- 2024Box It to Bind It: Unified Layout Control and Attribute Binding in T2I Diffusion Models27 Feb 2024