# Deep MR to CT Synthesis using Unpaired Data

arXiv: https://arxiv.org/abs/1708.01155 · HTML: https://mlsanity.com/paper/1708.01155/

## Key facts

- Cited by 86 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Aug 2017.

## Built on by (most cited first, 30 of 86)

- [Domain Adaptation for Medical Image Analysis: A Survey](https://mlsanity.com/paper/2102.09508/) (2021)
- [Transformers in Medical Imaging: A Survey](https://mlsanity.com/paper/2201.09873/) (2022)
- [Unsupervised Medical Image Translation with Adversarial Diffusion Models](https://mlsanity.com/paper/2207.08208/) (2022)
- [ResViT: Residual vision transformers for multi-modal medical image synthesis](https://mlsanity.com/paper/2106.16031/) (2021)
- [Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review](https://mlsanity.com/paper/2307.13125/) (2023)
- [Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model](https://mlsanity.com/paper/2305.19467/) (2023)
- [Deep learning-based synthetic-CT generation in radiotherapy and PET: a review](https://mlsanity.com/paper/2102.02734/) (2021)
- [Self-Consistent Recursive Diffusion Bridge for Medical Image Translation](https://mlsanity.com/paper/2405.06789/) (2024)
- [I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling](https://mlsanity.com/paper/2405.14022/) (2024)
- [Self-Attentive Spatial Adaptive Normalization for Cross-Modality Domain Adaptation](https://mlsanity.com/paper/2103.03781/) (2021)
- [One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesis](https://mlsanity.com/paper/2207.06509/) (2022)
- [Low-field magnetic resonance image enhancement via stochastic image quality transfer](https://mlsanity.com/paper/2304.13385/) (2023)
- [Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translation](https://mlsanity.com/paper/2307.16143/) (2023)
- [Fr'echet Radiomic Distance (FRD): A Versatile Metric for Comparing Medical Imaging Datasets](https://mlsanity.com/paper/2412.01496/) (2024)
- [Information-based Disentangled Representation Learning for Unsupervised MR Harmonization](https://mlsanity.com/paper/2103.13283/) (2021)
- [Free-form tumor synthesis in computed tomography images via richer generative adversarial network](https://mlsanity.com/paper/2104.09701/) (2021)
- [Uncertainty-Guided Progressive GANs for Medical Image Translation](https://mlsanity.com/paper/2106.15542/) (2021)
- [MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Disease](https://mlsanity.com/paper/2108.02160/) (2021)
- [Data synthesis and adversarial networks: A review and meta-analysis in cancer imaging](https://mlsanity.com/paper/2107.09543/) (2021)
- [medigan: a Python library of pretrained generative models for medical image synthesis](https://mlsanity.com/paper/2209.14472/) (2022)
- [Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data](https://mlsanity.com/paper/2406.18547/) (2024)
- [EEG to fMRI Synthesis Benefits from Attentional Graphs of Electrode Relationships](https://mlsanity.com/paper/2203.03481/) (2022)
- [Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusion](https://mlsanity.com/paper/2303.02094/) (2023)
- [Bridging the gap between paired and unpaired medical image translation](https://mlsanity.com/paper/2110.08407/) (2021)
- [DC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Data](https://mlsanity.com/paper/2211.01293/) (2022)
- [Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion](https://mlsanity.com/paper/2301.13743/) (2023)
- [Simulating Dynamic Tumor Contrast Enhancement in Breast MRI using Conditional Generative Adversarial Networks](https://mlsanity.com/paper/2409.18872/) (2024)
- [Deep Class-Specific Affinity-Guided Convolutional Network for Multimodal Unpaired Image Segmentation](https://mlsanity.com/paper/2101.01513/) (2021)
- [Synthesizing MR Image Contrast Enhancement Using 3D High-resolution ConvNets](https://mlsanity.com/paper/2104.01592/) (2021)
- [SA-GAN: Structure-Aware GAN for Organ-Preserving Synthetic CT Generation](https://mlsanity.com/paper/2105.07044/) (2021)

## Abstract (arXiv)

MR-only radiotherapy treatment planning requires accurate MR-to-CT synthesis. Current deep learning methods for MR-to-CT synthesis depend on pairwise aligned MR and CT training images of the same patient. However, misalignment between paired images could lead to errors in synthesized CT images. To overcome this, we propose to train a generative adversarial network (GAN) with unpaired MR and CT images. A GAN consisting of two synthesis convolutional neural networks (CNNs) and two discriminator CNNs was trained with cycle consistency to transform 2D brain MR image slices into 2D brain CT image slices and vice versa. Brain MR and CT images of 24 patients were analyzed. A quantitative evaluation showed that the model was able to synthesize CT images that closely approximate reference CT images, and was able to outperform a GAN model trained with paired MR and CT images.
