Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model
Not on the map. Why?
Abstract (arXiv)
MRI and PET are crucial diagnostic tools for brain diseases, as they provide complementary information on brain structure and function. However, PET scanning is costly and involves radioactive exposure, resulting in a lack of PET. Moreover, simultaneous PET and MRI at ultra-high-field are currently hardly infeasible. Ultra-high-field imaging has unquestionably proven valuable in both clinical and academic settings, especially in the field of cognitive neuroimaging. These motivate us to propose a method for synthetic PET from high-filed MRI and ultra-high-field MRI. From a statistical perspective, the joint probability distribution (JPD) is the most direct and fundamental means of portraying the correlation between PET and MRI. This paper proposes a novel joint diffusion attention model which has the joint probability distribution and attention strategy, named JDAM. JDAM has a diffusion process and a sampling process. The diffusion process involves the gradual diffusion of PET to Gaussian noise by adding Gaussian noise, while MRI remains fixed. JPD of MRI and noise-added PET was learned in the diffusion process. The sampling process is a predictor-corrector. PET images were generated from MRI by JPD of MRI and noise-added PET. The predictor is a reverse diffusion process and the corrector is Langevin dynamics. Experimental results on the public Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that the proposed method outperforms state-of-the-art CycleGAN for high-field MRI (3T MRI). Finally, synthetic PET images from the ultra-high-field (5T MRI and 7T MRI) be attempted, providing a possibility for ultra-high-field PET-MRI imaging.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 6 May 2023.
Builds on
20 of 38 references.
References · 20
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Generative Adversarial Networkscited by 5,603
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2016Density estimation using Real NVPcited by 2,029
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
8 more
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
- 2021Generating Images with Sparse Representationscited by 262
- 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 133
- 2019LOGAN: Latent Optimisation for Generative Adversarial Networkscited by 42
- 2022Brain PET Synthesis from MRI Using Joint Probability Distribution of Diffusion Model at Ultrahigh Fieldscited by 5
- 2022Brain MRI-to-PET Synthesis using 3D Convolutional Attention Networkscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 4; 2026: 5.
14 papers.
Sort:
By area:
- 20253D Wavelet Latent Diffusion Model for Whole-Body MR-to-CT Modality Translationcited by 3
- 2024Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Medical Image Synthesis: T1w MRI to Tau PETcited by 2
- 2024Pseudo-MRI-Guided PET Image Reconstruction Method Based on a Diffusion Probabilistic Modelcited by 1
- 2025GAN-based synthetic FDG PET images from T1 brain MRI can serve to improve performance of deep unsupervised anomaly detection modelscited by 1
- 2026RelA-Diffusion: Relativistic Adversarial Diffusion for Multi-Tracer PET Synthesis from Multi-Sequence MRIcited by 1
- 2023Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translationcited by 0
- 2024Predicting Hypoxia in Brain Tumors from Multiparametric MRIcited by 0
- 2024Synthesizing beta-amyloid PET images from T1-weighted Structural MRI: A Preliminary Studycited by 0
- 2025A Prior-Guided Joint Diffusion Model in Projection Domain for PET Tracer Conversioncited by 0
- 2025Double-Constraint Diffusion Model with Nuclear Regularization for Ultra-low-dose PET Reconstructioncited by 0
- 2026Precision Synthesis of Multi-Tracer PET via VLM-Modulated Rectified Flow for Stratifying Mild Cognitive Impairmentcited by 0
- 2026A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancercited by 0
- 2026Bridging Modalities on the Cortex: Surface-based MRI to PET Translation with a Diffusion Bridge17 Sep 2026
- 2026Flow Matching-Based PET Image Reconstruction20 Aug 2026
- 2026A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancer23 Jul 2026
- 2026Precision Synthesis of Multi-Tracer PET via VLM-Modulated Rectified Flow for Stratifying Mild Cognitive Impairment13 Apr 2026
- 2026RelA-Diffusion: Relativistic Adversarial Diffusion for Multi-Tracer PET Synthesis from Multi-Sequence MRI24 Feb 2026
- 2025Double-Constraint Diffusion Model with Nuclear Regularization for Ultra-low-dose PET Reconstruction30 Aug 2025
- 20253D Wavelet Latent Diffusion Model for Whole-Body MR-to-CT Modality Translation14 Jul 2025
- 2025A Prior-Guided Joint Diffusion Model in Projection Domain for PET Tracer Conversion20 Jun 2025
- 2025GAN-based synthetic FDG PET images from T1 brain MRI can serve to improve performance of deep unsupervised anomaly detection models12 May 2025
- 2024Synthesizing beta-amyloid PET images from T1-weighted Structural MRI: A Preliminary Study26 Sep 2024
- 2024Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Medical Image Synthesis: T1w MRI to Tau PET18 Jun 2024
- 2024Pseudo-MRI-Guided PET Image Reconstruction Method Based on a Diffusion Probabilistic Model26 Mar 2024
2 more
- 20253D Wavelet Latent Diffusion Model for Whole-Body MR-to-CT Modality Translationcited by 3
- 2024Pseudo-MRI-Guided PET Image Reconstruction Method Based on a Diffusion Probabilistic Modelcited by 1
- 2023Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translationcited by 0
- 2025Double-Constraint Diffusion Model with Nuclear Regularization for Ultra-low-dose PET Reconstructioncited by 0
- 2026Precision Synthesis of Multi-Tracer PET via VLM-Modulated Rectified Flow for Stratifying Mild Cognitive Impairmentcited by 0
- 2026Flow Matching-Based PET Image Reconstructioncited by 0
- 2026Flow Matching-Based PET Image Reconstruction20 Aug 2026
- 2026Precision Synthesis of Multi-Tracer PET via VLM-Modulated Rectified Flow for Stratifying Mild Cognitive Impairment13 Apr 2026
- 2025Double-Constraint Diffusion Model with Nuclear Regularization for Ultra-low-dose PET Reconstruction30 Aug 2025
- 20253D Wavelet Latent Diffusion Model for Whole-Body MR-to-CT Modality Translation14 Jul 2025
- 2024Pseudo-MRI-Guided PET Image Reconstruction Method Based on a Diffusion Probabilistic Model26 Mar 2024
- 2023Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translation25 Sep 2023
- 2024Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Medical Image Synthesis: T1w MRI to Tau PETcited by 2
- 2025GAN-based synthetic FDG PET images from T1 brain MRI can serve to improve performance of deep unsupervised anomaly detection modelscited by 1
- 2026RelA-Diffusion: Relativistic Adversarial Diffusion for Multi-Tracer PET Synthesis from Multi-Sequence MRIcited by 1
- 2024Predicting Hypoxia in Brain Tumors from Multiparametric MRIcited by 0
- 2024Synthesizing beta-amyloid PET images from T1-weighted Structural MRI: A Preliminary Studycited by 0
- 2025A Prior-Guided Joint Diffusion Model in Projection Domain for PET Tracer Conversioncited by 0
- 2026A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancercited by 0
- 2026Bridging Modalities on the Cortex: Surface-based MRI to PET Translation with a Diffusion Bridgecited by 0
- 2026Bridging Modalities on the Cortex: Surface-based MRI to PET Translation with a Diffusion Bridge17 Sep 2026
- 2026A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancer23 Jul 2026
- 2026RelA-Diffusion: Relativistic Adversarial Diffusion for Multi-Tracer PET Synthesis from Multi-Sequence MRI24 Feb 2026
- 2025A Prior-Guided Joint Diffusion Model in Projection Domain for PET Tracer Conversion20 Jun 2025
- 2025GAN-based synthetic FDG PET images from T1 brain MRI can serve to improve performance of deep unsupervised anomaly detection models12 May 2025
- 2024Synthesizing beta-amyloid PET images from T1-weighted Structural MRI: A Preliminary Study26 Sep 2024
- 2024Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Medical Image Synthesis: T1w MRI to Tau PET18 Jun 2024
- 2024Predicting Hypoxia in Brain Tumors from Multiparametric MRI25 Jan 2024