mlsanityData to 14 Oct 2026

Longitudinal Causal Image Synthesis

arXiv 2410.17691 ↗First posted 23 Oct 2024eess.IV cs.CV q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical decision-making relies heavily on causal reasoning and longitudinal analysis. For example, for a patient with Alzheimer's disease (AD), how will the brain grey matter atrophy in a year if intervened on the A-beta level in cerebrospinal fluid? The answer is fundamental to diagnosis and follow-up treatment. However, this kind of inquiry involves counterfactual medical images which can not be acquired by instrumental or correlation-based image synthesis models. Yet, such queries require counterfactual medical images, not obtainable through standard image synthesis models. Hence, a causal longitudinal image synthesis (CLIS) method, enabling the synthesis of such images, is highly valuable. However, building a CLIS model confronts three primary yet unmet challenges: mismatched dimensionality between high-dimensional images and low-dimensional tabular variables, inconsistent collection intervals of follow-up data, and inadequate causal modeling capability of existing causal graph methods for image data. In this paper, we established a tabular-visual causal graph (TVCG) for CLIS overcoming these challenges through a novel integration of generative imaging, continuous-time modeling, and structural causal models combined with a neural network. We train our CLIS based on the ADNI dataset and evaluate it on two other AD datasets, which illustrate the outstanding yet controllable quality of the synthesized images and the contributions of synthesized MRI to the characterization of AD progression, substantiating the reliability and utility in clinics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 116 references that are in the map. First posted on arXiv 23 Oct 2024.

Builds on

31 of 116 references.

References · 31

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2017Improved Training of Wasserstein GANscited by 2,235
  8. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  9. 2019Neural Spline Flowscited by 596
  10. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  11. 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
  12. 2022Brain Imaging Generation with Latent Diffusion Modelscited by 268
19 more
  1. 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 211
  2. 2013Causal Inference in the Presence of Latent Variables and Selection Biascited by 166
  3. 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 132
  4. 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
  5. 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
  6. 2022What is Healthy? Generative Counterfactual Diffusion for Lesion Localizationcited by 52
  7. 2017Visual Feature Attribution using Wasserstein GANscited by 47
  8. 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
  9. 2020Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesiscited by 38
  10. 20213D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Imagescited by 32
  11. 2021A Structural Causal Model for MR Images of Multiple Sclerosiscited by 21
  12. 2022Diagnose Like a Radiologist: Hybrid Neuro-Probabilistic Reasoning for Attribute-Based Medical Image Diagnosiscited by 21
  13. 2023Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translationcited by 19
  14. 2021Learn-Explain-Reinforce: Counterfactual Reasoning and Its Guidance to Reinforce an Alzheimer's Disease Diagnosis Modelcited by 14
  15. 2022Counterfactual Image Synthesis for Discovery of Personalized Predictive Image Markerscited by 10
  16. 2020Towards Causality-Aware Inferring: A Sequential Discriminative Approach for Medical Diagnosiscited by 4
  17. 2018Personalized Gaussian Processes for Forecasting of Alzheimer's Disease Assessment Scale-Cognition Sub-Scale (ADAS-Cog13)cited by 3
  18. 2022Multi-task longitudinal forecasting with missing values on Alzheimer's Diseasecited by 3
  19. 2019Robust parametric modeling of Alzheimer's disease progressioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Causal Disentanglement for Robust Long-tail Medical Image Generation
  2. 2026Generating Medical Image Counterfactuals using Causal Explanations
  3. 2025Cross-modal Causal Intervention for Alzheimer's Disease Prediction
  4. 2025Integrating Anatomical Priors into a Causal Diffusion Model
  5. 2023BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
  6. 2024MACAW: A Causal Generative Model for Medical Imaging
  7. 2024Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis
  8. 2025Cycle Diffusion Model for Counterfactual Image Generation