mlsanityData to 7 Oct 2026

Deformation-Recovery Diffusion Model (DRDM): Instance Deformation for Image Manipulation and Synthesis

arXiv 2407.07295 ↗First posted 10 Jul 2024eess.IV cs.CE cs.CVcited by 7

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically implausible structures or illusions. To address these limitations, we propose the Deformation-Recovery Diffusion Model (DRDM), a novel diffusion-based generative model that emphasises morphological transformation through deformation fields rather than direct image synthesis. DRDM introduces a topology-preserving deformation field generation strategy, which randomly samples and integrates multi-scale Deformation Velocity Fields (DVFs). DRDM is trained to learn to recover unrealistic deformation components, thus restoring randomly deformed images to a realistic distribution. This formulation enables the generation of diverse yet anatomically plausible deformations that preserve structural integrity, thereby improving data augmentation and synthesis for downstream tasks such as few-shot learning and image registration. Experiments on cardiac Magnetic Resonance Imaging and pulmonary Computed Tomography show that DRDM is capable of creating diverse, large-scale deformations, while maintaining anatomical plausibility of deformation fields. Additional evaluations on 2D image segmentation and 3D image registration tasks indicate notable performance gains, underscoring DRDM's potential to enhance both image manipulation and generative modelling in medical imaging applications. Project page: https://jianqingzheng.github.io/def_diff_rec/

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 35 of its 81 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

35 of 81 references.

Closest ancestors · 15

Same direction, newest first

  1. 2024Fast-DDPM: Fast Denoising Diffusion Probabilistic Models for Medical Image-to-Image Generation23 May
  2. 2024VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis9 May
  3. 2024Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models26 Mar
  4. 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model19 Oct
  5. 2023ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models3 Sep
  6. 2023Modality Cycles with Masked Conditional Diffusion for Unsupervised Anomaly Segmentation in MRI30 Aug
  7. 2023Denoising diffusion-based MRI to CT image translation enables automated spinal segmentation18 Aug
  8. 2023FSDiffReg: Feature-wise and Score-wise Diffusion-guided Unsupervised Deformable Image Registration for Cardiac Images22 Jul
  9. 2023Mask, Stitch, and Re-Sample: Enhancing Robustness and Generalizability in Anomaly Detection through Automatic Diffusion Models31 May
  10. 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis29 May
  11. 2023Diffusion Model based Semi-supervised Learning on Brain Hemorrhage Images for Efficient Midline Shift Quantification1 Jan
  12. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov
3 more
  1. 2022Brain Imaging Generation with Latent Diffusion Models15 Sep
  2. 2022Diffusion Models for Medical Anomaly Detection8 Mar
  3. 2021DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Model9 Dec

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  8. 2015Spatial Transformer Networkscited by 1,423
  9. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  10. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
  11. 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
  12. 2020How Much Position Information Do Convolutional Neural Networks Encode?cited by 171
8 more
  1. 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
  2. 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
  3. 2019Semi-Supervised Medical Image Segmentation via Learning Consistency under Transformationscited by 71
  4. 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
  5. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  6. 2022When CNN Meet with ViT: Towards Semi-Supervised Learning for Multi-Class Medical Image Semantic Segmentationcited by 13
  7. 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentationcited by 12
  8. 2022Recursive Deformable Image Registration Network with Mutual Attentioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 3.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024DiffuseReg: Denoising Diffusion Model for Obtaining Deformation Fields in Unsupervised Deformable Image Registration
  2. 2025IGG: Image Generation Informed by Geodesic Dynamics in Deformation Spaces
  3. 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priors
  4. 2025Guiding Registration with Emergent Similarity from Pre-Trained Diffusion Models
  5. 2026Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generation
  6. 2024Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlases
  7. 2024Multi-Conditioned Denoising Diffusion Probabilistic Model (mDDPM) for Medical Image Synthesis
  8. 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis