Unsupervised Medical Image Translation with Adversarial Diffusion Models
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.
Key facts. Cited by 191 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 44 of its 86 references that are in the map. First posted on arXiv 17 Jul 2022.
Builds on
44 of 86 references.
Closest ancestors · 6
Same direction, newest first
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstruction12 Jul
- 2022A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion7 Jul
- 2022Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models7 Jun
- 2022Diffusion Models for Medical Anomaly Detection8 Mar
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Models15 Nov
- 2021Score-based diffusion models for accelerated MRI8 Oct
Other references · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
26 more
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
- 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 284
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
- 2018MedGAN: Medical Image Translation using GANscited by 152
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
- 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
- 2017Deep MR to CT Synthesis using Unpaired Datacited by 86
- 2020Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesiscited by 86
- 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 76
- 2022MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusioncited by 66
- 2018Cross-modality image synthesis from unpaired data using CycleGAN: Effects of gradient consistency loss and training data sizecited by 42
- 2019DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesiscited by 36
- 2019mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesiscited by 34
- 2017Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images using Weakly-Supervised Joint Convolutional Sparse Codingcited by 33
- 2019CollaGAN : Collaborative GAN for Missing Image Data Imputationcited by 33
- 2022Federated Learning of Generative Image Priors for MRI Reconstructioncited by 33
- 2018Deep CT to MR Synthesis using Paired and Unpaired Datacited by 31
- 2018Unpaired Brain MR-to-CT Synthesis using a Structure-Constrained CycleGANcited by 31
- 2021Unsupervised Domain Adaptation with Variational Approximation for Cardiac Segmentationcited by 28
- 2021TranSMS: Transformers for Super-Resolution Calibration in Magnetic Particle Imagingcited by 18
- 2020Semi-Supervised Learning of Mutually Accelerated MRI Synthesis without Fully-Sampled Ground Truthscited by 3
Built on by
Citing papers per year: 2022: 8; 2023: 32; 2024: 71; 2025: 48; 2026: 32.
191 papers.
Sort:
By area:
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 85
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2023CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesiscited by 64
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 53
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Reviewcited by 48
- 2023Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Imagescited by 45
- 2023Zero-shot Medical Image Translation via Frequency-Guided Diffusion Modelscited by 39
38 more
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2024Fast-DDPM: Fast Denoising Diffusion Probabilistic Models for Medical Image-to-Image Generationcited by 33
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Futurecited by 31
- 2024Rethinking Diffusion Model for Multi-Contrast MRI Super-Resolutioncited by 29
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2022A Diffusion Model Predicts 3D Shapes from 2D Microscopy Imagescited by 24
- 2024Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challengescited by 24
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Modelcited by 23
- 2024EDA-DM: Enhanced Distribution Alignment for Post-Training Quantization of Diffusion Modelscited by 23
- 2022Few-shot Image Generation with Diffusion Modelscited by 21
- 2023Diffusion Modeling with Domain-conditioned Prior Guidance for Accelerated MRI and qMRI Reconstructioncited by 20
- 2023Diffusion Models for Contrast Harmonization of Magnetic Resonance Imagescited by 19
- 2023Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesiscited by 19
- 2024Generative AI Enables EEG Super-Resolution via Spatio-Temporal Adaptive Diffusion Learningcited by 17
- 2023Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Actioncited by 15
- 2023MRI Reconstruction with Side Information using Diffusion Modelscited by 15
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
- 2023Denoising diffusion-based MRI to CT image translation enables automated spinal segmentationcited by 15
- 2023DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRIcited by 14
- 2024FreeTumor: Advance Tumor Segmentation via Large-Scale Tumor Synthesiscited by 14
- 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?cited by 14
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 13
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Imagescited by 13
- 2024Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problemscited by 13
- 2024Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Modelscited by 13
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2025Metrics that matter: Evaluating image quality metrics for medical image generationcited by 12
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstructioncited by 11
- 2024CATD: Unified Representation Learning for EEG-to-fMRI Cross-Modal Generationcited by 11
- 2024Analyzing Tumors by Synthesiscited by 11
- 2024DenoMamba: A fused state-space model for low-dose CT denoisingcited by 11
- 2023Semantic Image Synthesis for Abdominal CTcited by 10
- 2024PASTA: Pathology-Aware MRI to PET Cross-Modal Translation with Diffusion Modelscited by 10
- 2023DiffuseIR:Diffusion Models For Isotropic Reconstruction of 3D Microscopic Imagescited by 9
- 2023A Survey of Emerging Applications of Diffusion Probabilistic Models in MRIcited by 9
- 2024A Survey on Domain Generalization for Medical Image Analysiscited by 9
50 most cited of 191 All 191 (JSON)
- 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement25 Sep 2026
- 2026Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generation8 Sep 2026
- 2026Synthesizing Post-Acetazolamide Cerebral Blood Flow Maps from Baseline MRI in Moyamoya Using 3D Generative AI14 Aug 2026
- 2026Posterior Samplings are Missing Modalities Generators for Medical Image Translation21 Jul 2026
- 2026Spectral Consistent Flow for One-step 3D Medical Image Translation12 Jul 2026
- 2026AA-ViT: Anatomically Aware Vision Transformer with Structural and Frequency Guidance for Contrast Enhanced Brain MRI Synthesis8 Jul 2026
- 2026Heterogeneity-Adaptive Diffusion Schrodinger Bridge for PET-Guided Whole-Body MRI Translation8 Jul 2026
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation26 Jun 2026
- 2026Prob-BBDM: a Probabilistic Brownian Bridge Diffusion Model for MRI sequence image-to-image translation23 Jun 2026
- 2026Unified MRI Brain Image Translation via Hierarchical Tumor Structure Comparison11 Jun 2026
- 2026SynerMedGen: Synergizing Medical Multimodal Understanding with Generation via Task Alignment9 May 2026
- 2026WFM: 3D Wavelet Flow Matching for Ultrafast Multi-Modal MRI Synthesis22 Apr 2026
38 more
- 2026Generative Drifting for Conditional Medical Image Generation21 Apr 2026
- 2026CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder17 Apr 2026
- 2026Domain-Specific Latent Representations Improve the Fidelity of Diffusion-Based Medical Image Super-Resolution14 Apr 2026
- 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology9 Apr 2026
- 2026PHASOR: Anatomy- and Phase-Consistent Volumetric Diffusion for CT Virtual Contrast Enhancement1 Apr 2026
- 2026MRI-to-CT synthesis using drifting models30 Mar 2026
- 2026MUST: Modality-Specific Representation-Aware Transformer for Diffusion-Enhanced Survival Prediction with Missing Modality27 Mar 2026
- 2026Translating MRI to PET through Conditional Diffusion Models with Enhanced Pathology Awareness19 Mar 2026
- 2026Multiscale Structure-Guided Latent Diffusion for Multimodal MRI Translation13 Mar 2026
- 2026RAFM: Retrieval-Augmented Flow Matching for Unpaired CBCT-to-CT Translation28 Feb 2026
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets23 Feb 2026
- 2026Unpaired Image-to-Image Translation via a Self-Supervised Semantic Bridge18 Feb 2026
- 2026A Unified Framework for Multimodal Image Reconstruction and Synthesis using Denoising Diffusion Models9 Feb 2026
- 2026Structure-constrained Language-informed Diffusion Model for Unpaired Low-dose Computed Tomography Angiography Reconstruction28 Jan 2026
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation26 Jan 2026
- 2026PAINT: Pathology-Aware Integrated Next-Scale Transformation for Virtual Immunohistochemistry22 Jan 2026
- 2026Pairing-free Group-level Knowledge Distillation for Robust Gastrointestinal Lesion Classification in White-Light Endoscopy14 Jan 2026
- 2026Controllable Diffusion-Based Lesion Inpainting for Scalable Histopathology Data Augmentation13 Jan 2026
- 2026SRUG: A Fusion-Driven Generator Network for Medical Image Translation8 Jan 2026
- 2026NeuroSSM: Multiscale Differential State-Space Modeling for Context-Aware fMRI Analysis3 Jan 2026
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancement8 Dec 2025
- 2025ReBrain: Brain MRI Reconstruction from Sparse CT Slice via Retrieval-Augmented Diffusion21 Nov 2025
- 2025MRI Super-Resolution with Deep Learning: A Comprehensive Survey20 Nov 2025
- 2025BrainNormalizer: Anatomy-Informed Pseudo-Healthy Brain Reconstruction from Tumor MRI via Edge-Guided ControlNet17 Nov 2025
- 2025PADM: A Physics-aware Diffusion Model for Attenuation Correction10 Nov 2025
- 2025Pattern-Aware Diffusion Synthesis of fMRI/dMRI with Tissue and Microstructural Refinement7 Nov 2025
- 2025Curvilinear Structure-preserving Unpaired Cross-domain Medical Image Translation22 Oct 2025
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025Cyclic Self-Supervised Diffusion for Ultra Low-field to High-field MRI Synthesis15 Oct 2025
- 2025FS-RWKV: Leveraging Frequency Spatial-Aware RWKV for 3T-to-7T MRI Translation10 Oct 2025
- 2025From Noisy to Native: LLM-driven Graph Restoration for Test-Time Graph Domain Adaptation9 Oct 2025
- 2025Bidirectional Mammogram View Translation with Column-Aware and Implicit 3D Conditional Diffusion6 Oct 2025
- 2025Anatomy-DT: A Cross-Diffusion Digital Twin for Anatomical Evolution29 Sep 2025
- 2025Adaptive Dual-Mode Distillation with Incentive Schemes for Scalable, Heterogeneous Federated Learning on Non-IID Data26 Sep 2025
- 2025Contrastive Anatomy-Contrast Disentanglement: A Domain-General MRI Harmonization Method8 Sep 2025
- 2025MedVista3D: Vision-Language Modeling for Reducing Diagnostic Errors in 3D CT Disease Detection, Understanding and Reporting4 Sep 2025
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptation29 Aug 2025
- 2025UniSino: Physics-Driven Foundational Model for Universal CT Sinogram Standardization25 Aug 2025
50 newest of 191 All 191 (JSON)
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 85
- 2023CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesiscited by 64
- 2023Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Imagescited by 45
- 2023Zero-shot Medical Image Translation via Frequency-Guided Diffusion Modelscited by 39
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2024Fast-DDPM: Fast Denoising Diffusion Probabilistic Models for Medical Image-to-Image Generationcited by 33
- 2024Rethinking Diffusion Model for Multi-Contrast MRI Super-Resolutioncited by 29
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
12 most cited of 90 All 90 (JSON)
- 2026Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generation8 Sep 2026
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation26 Jun 2026
- 2026Prob-BBDM: a Probabilistic Brownian Bridge Diffusion Model for MRI sequence image-to-image translation23 Jun 2026
- 2026WFM: 3D Wavelet Flow Matching for Ultrafast Multi-Modal MRI Synthesis22 Apr 2026
- 2026CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder17 Apr 2026
- 2026Domain-Specific Latent Representations Improve the Fidelity of Diffusion-Based Medical Image Super-Resolution14 Apr 2026
- 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology9 Apr 2026
- 2026MRI-to-CT synthesis using drifting models30 Mar 2026
- 2026Translating MRI to PET through Conditional Diffusion Models with Enhanced Pathology Awareness19 Mar 2026
- 2026Multiscale Structure-Guided Latent Diffusion for Multimodal MRI Translation13 Mar 2026
- 2026RAFM: Retrieval-Augmented Flow Matching for Unpaired CBCT-to-CT Translation28 Feb 2026
- 2026A Unified Framework for Multimodal Image Reconstruction and Synthesis using Denoising Diffusion Models9 Feb 2026
12 newest of 90 All 90 (JSON)
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 53
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Reviewcited by 48
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
- 2023DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRIcited by 14
- 2024FreeTumor: Advance Tumor Segmentation via Large-Scale Tumor Synthesiscited by 14
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Imagescited by 13
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2025Metrics that matter: Evaluating image quality metrics for medical image generationcited by 12
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstructioncited by 11
- 2024CATD: Unified Representation Learning for EEG-to-fMRI Cross-Modal Generationcited by 11
12 most cited of 95 All 95 (JSON)
- 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement25 Sep 2026
- 2026Synthesizing Post-Acetazolamide Cerebral Blood Flow Maps from Baseline MRI in Moyamoya Using 3D Generative AI14 Aug 2026
- 2026Posterior Samplings are Missing Modalities Generators for Medical Image Translation21 Jul 2026
- 2026Spectral Consistent Flow for One-step 3D Medical Image Translation12 Jul 2026
- 2026AA-ViT: Anatomically Aware Vision Transformer with Structural and Frequency Guidance for Contrast Enhanced Brain MRI Synthesis8 Jul 2026
- 2026Heterogeneity-Adaptive Diffusion Schrodinger Bridge for PET-Guided Whole-Body MRI Translation8 Jul 2026
- 2026Unified MRI Brain Image Translation via Hierarchical Tumor Structure Comparison11 Jun 2026
- 2026SynerMedGen: Synergizing Medical Multimodal Understanding with Generation via Task Alignment9 May 2026
- 2026Generative Drifting for Conditional Medical Image Generation21 Apr 2026
- 2026PHASOR: Anatomy- and Phase-Consistent Volumetric Diffusion for CT Virtual Contrast Enhancement1 Apr 2026
- 2026MUST: Modality-Specific Representation-Aware Transformer for Diffusion-Enhanced Survival Prediction with Missing Modality27 Mar 2026
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets23 Feb 2026
12 newest of 95 All 95 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Cross-conditioned Diffusion Model for Medical Image to Image Translation
- 2025Benchmarking GANs, Diffusion Models, and Flow Matching for T1w-to-T2w MRI Translation
- 2025Comparative Analysis of GAN and Diffusion for MRI-to-CT translation
- 2026Cross Modality Image Translation In Medical Imaging Using Generative Frameworks
- 2024Deep Generative Models for 3D Medical Image Synthesis
- 2022Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report
- 2022Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models
- 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis