mlsanityData to 7 Oct 2026

Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins

arXiv 2401.00247 ↗First posted 30 Dec 2023cs.CV eess.IVcited by 6

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Numerical simulations can model the physical processes that govern cardiovascular device deployment. When such simulations incorporate digital twins; computational models of patient-specific anatomy, they can expedite and de-risk the device design process. Nonetheless, the exclusive use of patient-specific data constrains the anatomic variability which can be precisely or fully explored. In this study, we investigate the capacity of Latent Diffusion Models (LDMs) to edit digital twins to create anatomic variants, which we term digital siblings. Digital twins and their corresponding siblings can serve as the basis for comparative simulations, enabling the study of how subtle anatomic variations impact the simulated deployment of cardiovascular devices, as well as the augmentation of virtual cohorts for device assessment. However, while diffusion models have been characterized in their ability to edit natural images, their capacity to anatomically edit digital twins has yet to be studied. Using a case example centered on 3D digital twins of cardiac anatomy, we implement various methods for generating digital siblings and characterize them through morphological and topological analyses. We specifically edit digital twins to introduce anatomic variation at different spatial scales and within localized regions, demonstrating the existence of bias towards common anatomic features. We further show that such anatomic bias can be leveraged for virtual cohort augmentation through selective editing, partially alleviating issues related to dataset imbalance and lack of diversity. Our experimental framework thus delineates the limits and capabilities of using latent diffusion models in synthesizing anatomic variation for in silico trials.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 19 of its 59 references that are in the map. First posted on arXiv 30 Dec 2023.

Builds on

19 of 59 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images3 Aug
  2. 2023Mask, Stitch, and Re-Sample: Enhancing Robustness and Generalizability in Anomaly Detection through Automatic Diffusion Models31 May
  3. 2023Generation of Structurally Realistic Retinal Fundus Images with Diffusion Models11 May
  4. 2022Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report21 Oct
  5. 2022Brain Imaging Generation with Latent Diffusion Models15 Sep
  6. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Models15 Nov

Other references · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  8. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  9. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  10. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  11. 2022Can segmentation models be trained with fully synthetically generated data?cited by 37
  12. 2022Learning Topological Interactions for Multi-Class Medical Image Segmentationcited by 28
1 more
  1. 2023CHeart: A Conditional Spatio-Temporal Generative Model for Cardiac Anatomycited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 1.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 20253D Cardiac Anatomy Generation Using Mesh Latent Diffusion Models
  2. 2026Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis
  3. 2026Uncertainty as a Proxy for Semantic Correctness in Diffusion-Based Medical Image Synthesis
  4. 2025seg2med: a bridge from artificial anatomy to multimodal medical images
  5. 2026Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation
  6. 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculature
  7. 2025Guiding Registration with Emergent Similarity from Pre-Trained Diffusion Models
  8. 2023Echocardiography video synthesis from end diastolic semantic map via diffusion model