mlsanityData to 7 Oct 2026

Causal Image Synthesis of Brain MR in 3D

arXiv 2303.14349 ↗First posted 25 Mar 2023eess.IV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical decision making requires counterfactual reasoning based on a factual medical image and thus necessitates causal image synthesis. To this end, we present a novel method for modeling the causality between demographic variables, clinical indices and brain MR images for Alzheimer's Diseases. Specifically, we leverage a structural causal model to depict the causality and a styled generator to synthesize the image. Furthermore, as a crucial step to reduce modeling complexity and make learning tractable, we propose the use of low dimensional latent feature representation of a high-dimensional 3D image, together with exogenous noise, to build causal relationship between the image and non image variables. We experiment the proposed method based on 1586 subjects and 3683 3D images and synthesize counterfactual brain MR images intervened on certain attributes, such as age, brain volume and cognitive test score. Quantitative metrics and qualitative evaluation of counterfactual images demonstrates the superiority of our generated images.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 25 Mar 2023.

Builds on

20 of 33 references.

References · 20

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  3. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  4. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  5. 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
  6. 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
  7. 2019Causality matters in medical imagingcited by 193
  8. 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
  9. 2022What is Healthy? Generative Counterfactual Diffusion for Lesion Localizationcited by 52
  10. 20183D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning from a 2D Trained Networkcited by 47
  11. 2021Using StyleGAN for Visual Interpretability of Deep Learning Models on Medical Imagescited by 35
  12. 20213D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Imagescited by 32
8 more
  1. 2020Vox2Vox: 3D-GAN for Brain Tumour Segmentationcited by 30
  2. 2021A Structural Causal Model for MR Images of Multiple Sclerosiscited by 21
  3. 2022A Review of Causality for Learning Algorithms in Medical Image Analysiscited by 18
  4. 2020Memory-efficient GAN-based Domain Translation of High Resolution 3D Medical Imagescited by 14
  5. 2019Virtual Thin Slice: 3D Conditional GAN-based Super-resolution for CT Slice Intervalcited by 11
  6. 2022Counterfactual Image Synthesis for Discovery of Personalized Predictive Image Markerscited by 10
  7. 2018Bivariate Causal Discovery and its Applications to Gene Expression and Imaging Data Analysiscited by 5
  8. 2022Semantic Unfolding of StyleGAN Latent Spacecited by 4

Built on by

Not cited yet.