Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin
Not on the map. Why?
Abstract (arXiv)
Generating positron emission tomography (PET) images from computed tomography (CT) scans via deep learning offers a promising pathway to reduce radiation exposure and costs associated with PET imaging, improving patient care and accessibility to functional imaging. Whole-body image translation presents challenges due to anatomical heterogeneity, often limiting generalized models. We propose a framework that segments whole-body CT images into four regions-head, trunk, arms, and legs-and uses district-specific Generative Adversarial Networks (GANs) for tailored CT-to-PET translation. Synthetic PET images from each region are stitched together to reconstruct the whole-body scan. Comparisons with a baseline non-segmented GAN and experiments with Pix2Pix and CycleGAN architectures tested paired and unpaired scenarios. Quantitative evaluations at district, whole-body, and lesion levels demonstrated significant improvements with our district-specific GANs. Pix2Pix yielded superior metrics, ensuring precise, high-quality image synthesis. By addressing anatomical heterogeneity, this approach achieves state-of-the-art results in whole-body CT-to-PET translation. This methodology supports healthcare Digital Twins by enabling accurate virtual PET scans from CT data, creating virtual imaging representations to monitor, predict, and optimize health outcomes.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 18 Mar 2025.
Builds on
10 of 27 references.
References · 10
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 132
- 2024A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applicationscited by 25
- 2022Multimodal Explainability via Latent Shift applied to COVID-19 stratificationcited by 16
- 2022Multi-objective optimization determines when, which and how to fuse deep networks: an application to predict COVID-19 outcomescited by 12
- 2023A Deep Learning Approach for Virtual Contrast Enhancement in Contrast Enhanced Spectral Mammographycited by 12
- 2024Multi-Dataset Multi-Task Learning for COVID-19 Prognosiscited by 11
- 2023A Deep Learning Approach for Overall Survival Prediction in Lung Cancer with Missing Valuescited by 9
- 2023A graph neural network-based model with Out-of-Distribution Robustness for enhancing Antiretroviral Therapy Outcome Prediction for HIV-1cited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generationcited by 1
- 2026Cross Modality Image Translation In Medical Imaging Using Generative Frameworkscited by 1
- 2026Longitudinal NSCLC Treatment Progression via Multimodal Generative Modelscited by 0
- 2026Virtual Scanning for NSCLC Histology: Investigating the Discriminatory Power of Synthetic PETcited by 0
- 20263D CT-to-PET Translation via Latent Brownian Bridge Diffusioncited by 0
- 20263D CT-to-PET Translation via Latent Brownian Bridge Diffusion11 Sep 2026
- 2026Cross Modality Image Translation In Medical Imaging Using Generative Frameworks13 May 2026
- 2026Virtual Scanning for NSCLC Histology: Investigating the Discriminatory Power of Synthetic PET4 May 2026
- 2026Longitudinal NSCLC Treatment Progression via Multimodal Generative Models6 Mar 2026
- 2025Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generation31 Mar 2025