Medical Image Synthesis with Context-Aware Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Computed tomography (CT) is critical for various clinical applications, e.g., radiotherapy treatment planning and also PET attenuation correction. However, CT exposes radiation during acquisition, which may cause side effects to patients. Compared to CT, magnetic resonance imaging (MRI) is much safer and does not involve any radiations. Therefore, recently, researchers are greatly motivated to estimate CT image from its corresponding MR image of the same subject for the case of radiotherapy planning. In this paper, we propose a data-driven approach to address this challenging problem. Specifically, we train a fully convolutional network to generate CT given an MR image. To better model the nonlinear relationship from MRI to CT and to produce more realistic images, we propose to use the adversarial training strategy and an image gradient difference loss function. We further apply AutoContext Model to implement a context-aware generative adversarial network. Experimental results show that our method is accurate and robust for predicting CT images from MRI images, and also outperforms three state-of-the-art methods under comparison.
Key facts. Cited by 91 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 14; 2023: 23; 2024: 12; 2025: 13; 2026: 10.
91 papers.
Sort:
By area:
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2021CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detectioncited by 64
- 2022Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesiscited by 41
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
- 2021VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformerscited by 28
- 2021Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptationcited by 24
- 2023Neuralizer: General Neuroimage Analysis without Re-Trainingcited by 24
- 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Surveycited by 20
- 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Losscited by 20
- 2023Diffusion Models for Contrast Harmonization of Magnetic Resonance Imagescited by 19
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial networkcited by 16
38 more
- 2021MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Diseasecited by 16
- 2021Data synthesis and adversarial networks: A review and meta-analysis in cancer imagingcited by 15
- 2024Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Imagescited by 15
- 2022Multi-scale Transformer Network with Edge-aware Pre-training for Cross-Modality MR Image Synthesiscited by 13
- 2023MedPrompt: Cross-Modal Prompting for Multi-Task Medical Image Translationcited by 13
- 2023Adversarial Fine-tuning using Generated Respiratory Sound to Address Class Imbalancecited by 11
- 2024PairAug: What Can Augmented Image-Text Pairs Do for Radiology?cited by 10
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencodercited by 10
- 2021Controllable cardiac synthesis via disentangled anatomy arithmeticcited by 9
- 2021Adversarial Deep Learning for Online Resource Allocationcited by 7
- 2022EEG to fMRI Synthesis Benefits from Attentional Graphs of Electrode Relationshipscited by 7
- 2023Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusioncited by 7
- 2021Deep Learning based Multi-modal Computing with Feature Disentanglement for MRI Image Synthesiscited by 6
- 2021Bridging the gap between paired and unpaired medical image translationcited by 6
- 2022Cross-Modality Neuroimage Synthesis: A Surveycited by 6
- 2022DC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Datacited by 6
- 2023Diffusion map particle systems for generative modelingcited by 6
- 2023PIE: Simulating Disease Progression via Progressive Image Editingcited by 6
- 2021Synthesizing MR Image Contrast Enhancement Using 3D High-resolution ConvNetscited by 5
- 2021SA-GAN: Structure-Aware GAN for Organ-Preserving Synthetic CT Generationcited by 5
- 2022Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directionscited by 5
- 2023Faithful Synthesis of Low-dose Contrast-enhanced Brain MRI Scans using Noise-preserving Conditional GANscited by 5
- 2021CT-SGAN: Computed Tomography Synthesis GANcited by 4
- 2023DermSynth3D: Synthesis of in-the-wild Annotated Dermatology Imagescited by 4
- 2024NT-ViT: Neural Transcoding Vision Transformers for EEG-to-fMRI Synthesiscited by 4
- 2025Data Can Speak for Itself: Quality-guided Utilization of Wireless Synthetic Datacited by 4
- 2021Generative Adversarial U-Net for Domain-free Medical Image Augmentationcited by 3
- 2021Frequency-Supervised MR-to-CT Image Synthesiscited by 3
- 2022Unified Framework for Histopathology Image Augmentation and Classification via Generative Modelscited by 3
- 2023Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distributioncited by 3
- 2023Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networkscited by 3
- 2025PanoGAN A Deep Generative Model for Panoramic Dental Radiographscited by 3
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translationcited by 3
- 2026Scalable next-scale autoregression for medical image generation across anatomical regionscited by 3
- 20213-D PET Image Generation with tumour masks using TGANcited by 2
- 2023Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Gradingcited by 2
- 2023BrainVoxGen: Deep learning framework for synthesis of Ultrasound to MRIcited by 2
- 2023A Unified Multi-Phase CT Synthesis and Classification Framework for Kidney Cancer Diagnosis with Incomplete Datacited by 2
50 most cited of 91 All 91 (JSON)
- 2026You Cannot Recover What Was Never Measured: Quantifying the Information Ceiling of Ultra-Low-Field MRI Super-Resolution29 Sep 2026
- 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement25 Sep 2026
- 2026Spectral Consistent Flow for One-step 3D Medical Image Translation12 Jul 2026
- 2026Dual-Domain Equivariant Generative Adversarial Network for Multimodal CT-PET Synthesis11 Jun 2026
- 2026Few-Shot Distribution-Aligned Flow Matching for Data Synthesis in Medical Image Segmentation3 Apr 2026
- 2026Mamba-driven MRI-to-CT Synthesis for MRI-only Radiotherapy Planning24 Mar 2026
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets23 Feb 2026
- 2026Scalable next-scale autoregression for medical image generation across anatomical regions16 Feb 2026
- 2026MRI Cross-Modal Synthesis: A Comparative Study of Generative Models for T1-to-T2 Reconstruction5 Feb 2026
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation26 Jan 2026
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification4 Dec 2025
- 2025The Age-specific Alzheimer 's Disease Prediction with Characteristic Constraints in Nonuniform Time Span26 Nov 2025
38 more
- 2025DEMIST: Decoupled Multi-stream latent diffusion for Quantitative Myelin Map Synthesis16 Nov 2025
- 2025Cyclic Self-Supervised Diffusion for Ultra Low-field to High-field MRI Synthesis15 Oct 2025
- 2025Flow Matching for Conditional MRI-CT and CBCT-CT Image Synthesis6 Oct 2025
- 2025BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Images28 Sep 2025
- 2025Comparative Analysis of GAN and Diffusion for MRI-to-CT translation26 Sep 2025
- 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss7 Aug 2025
- 2025PanoGAN A Deep Generative Model for Panoramic Dental Radiographs28 Jul 2025
- 2025Data Can Speak for Itself: Quality-guided Utilization of Wireless Synthetic Data29 Jun 2025
- 2025ViCTr: Vital Consistency Transfer for Pathology Aware Image Synthesis8 May 2025
- 20253D Nephrographic Image Synthesis in CT Urography with the Diffusion Model and Swin Transformer26 Feb 2025
- 2025Bidirectional Brain Image Translation using Transfer Learning from Generic Pre-trained Models21 Jan 2025
- 2024Structure-Guided MR-to-CT Synthesis with Spatial and Semantic Alignments for Attenuation Correction of Whole-Body PET/MR Imaging26 Nov 2024
- 2024GaNDLF-Synth: A Framework to Democratize Generative AI for (Bio)Medical Imaging30 Sep 2024
- 2024NT-ViT: Neural Transcoding Vision Transformers for EEG-to-fMRI Synthesis18 Sep 2024
- 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey23 Aug 2024
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder2 Aug 2024
- 2024Synthetic Test Data Generation Using Recurrent Neural Networks: A Position Paper7 Jul 2024
- 2024Improving Deep Learning-based Automatic Cranial Defect Reconstruction by Heavy Data Augmentation: From Image Registration to Latent Diffusion Models10 Jun 2024
- 2024HAGAN: Hybrid Augmented Generative Adversarial Network for Medical Image Synthesis8 May 2024
- 2024Improving Multi-Center Generalizability of GAN-Based Fat Suppression using Federated Learning10 Apr 2024
- 2024PairAug: What Can Augmented Image-Text Pairs Do for Radiology?7 Apr 2024
- 2024Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Images1 Apr 2024
- 2024Practical Applications of Advanced Cloud Services and Generative AI Systems in Medical Image Analysis26 Mar 2024
- 2023A Unified Multi-Phase CT Synthesis and Classification Framework for Kidney Cancer Diagnosis with Incomplete Data9 Dec 2023
- 2023Adversarial Fine-tuning using Generated Respiratory Sound to Address Class Imbalance11 Nov 2023
- 2023Feature-oriented Deep Learning Framework for Pulmonary Cone-beam CT (CBCT) Enhancement with Multi-task Customized Perceptual Loss1 Nov 2023
- 2023Enhanced Synthetic MRI Generation from CT Scans Using CycleGAN with Feature Extraction31 Oct 2023
- 2023BrainVoxGen: Deep learning framework for synthesis of Ultrasound to MRI11 Oct 2023
- 2023MedPrompt: Cross-Modal Prompting for Multi-Task Medical Image Translation4 Oct 2023
- 2023PIE: Simulating Disease Progression via Progressive Image Editing21 Sep 2023
- 2023Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks27 Aug 2023
- 2023Classification of lung cancer subtypes on CT images with synthetic pathological priors9 Aug 2023
- 2023Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distribution31 Jul 2023
- 2023Deepfake Image Generation for Improved Brain Tumor Segmentation26 Jul 2023
- 20233D Medical Image Segmentation based on multi-scale MPU-Net11 Jul 2023
- 2023Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification2 Jul 2023
- 2023Accurate 2D Reconstruction for PET Scanners based on the Analytical White Image Model30 Jun 2023
- 2023Faithful Synthesis of Low-dose Contrast-enhanced Brain MRI Scans using Noise-preserving Conditional GANs26 Jun 2023
50 newest of 91 All 91 (JSON)
- 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Losscited by 20
- 2023Diffusion Models for Contrast Harmonization of Magnetic Resonance Imagescited by 19
- 2023Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusioncited by 7
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translationcited by 3
- 2024Improving Deep Learning-based Automatic Cranial Defect Reconstruction by Heavy Data Augmentation: From Image Registration to Latent Diffusion Modelscited by 2
- 2025Flow Matching for Conditional MRI-CT and CBCT-CT Image Synthesiscited by 2
- 20253D Nephrographic Image Synthesis in CT Urography with the Diffusion Model and Swin Transformercited by 0
- 2025DEMIST: Decoupled Multi-stream latent diffusion for Quantitative Myelin Map Synthesiscited by 0
- 2026Few-Shot Distribution-Aligned Flow Matching for Data Synthesis in Medical Image Segmentationcited by 0
- 2026Few-Shot Distribution-Aligned Flow Matching for Data Synthesis in Medical Image Segmentation3 Apr 2026
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation26 Jan 2026
- 2025DEMIST: Decoupled Multi-stream latent diffusion for Quantitative Myelin Map Synthesis16 Nov 2025
- 2025Flow Matching for Conditional MRI-CT and CBCT-CT Image Synthesis6 Oct 2025
- 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss7 Aug 2025
- 20253D Nephrographic Image Synthesis in CT Urography with the Diffusion Model and Swin Transformer26 Feb 2025
- 2024Improving Deep Learning-based Automatic Cranial Defect Reconstruction by Heavy Data Augmentation: From Image Registration to Latent Diffusion Models10 Jun 2024
- 2023Diffusion Models for Contrast Harmonization of Magnetic Resonance Images14 Mar 2023
- 2023Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusion3 Mar 2023
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2021CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detectioncited by 64
- 2022Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesiscited by 41
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
- 2021VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformerscited by 28
- 2021Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptationcited by 24
- 2023Neuralizer: General Neuroimage Analysis without Re-Trainingcited by 24
- 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Surveycited by 20
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial networkcited by 16
- 2021MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Diseasecited by 16
- 2021Data synthesis and adversarial networks: A review and meta-analysis in cancer imagingcited by 15
12 most cited of 80 All 80 (JSON)
- 2026You Cannot Recover What Was Never Measured: Quantifying the Information Ceiling of Ultra-Low-Field MRI Super-Resolution29 Sep 2026
- 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement25 Sep 2026
- 2026Spectral Consistent Flow for One-step 3D Medical Image Translation12 Jul 2026
- 2026Dual-Domain Equivariant Generative Adversarial Network for Multimodal CT-PET Synthesis11 Jun 2026
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets23 Feb 2026
- 2026Scalable next-scale autoregression for medical image generation across anatomical regions16 Feb 2026
- 2026MRI Cross-Modal Synthesis: A Comparative Study of Generative Models for T1-to-T2 Reconstruction5 Feb 2026
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification4 Dec 2025
- 2025The Age-specific Alzheimer 's Disease Prediction with Characteristic Constraints in Nonuniform Time Span26 Nov 2025
- 2025Cyclic Self-Supervised Diffusion for Ultra Low-field to High-field MRI Synthesis15 Oct 2025
- 2025BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Images28 Sep 2025
- 2025Comparative Analysis of GAN and Diffusion for MRI-to-CT translation26 Sep 2025
12 newest of 80 All 80 (JSON)