mlsanityData to 7 Oct 2026

Head and Neck Tumor Segmentation from [18F]F-FDG PET/CT Images Based on 3D Diffusion Model

arXiv 2401.17593 ↗First posted 31 Jan 2024eess.IV cs.CV physics.med-phcited by 2

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Head and neck (H&N) cancers are among the most prevalent types of cancer worldwide, and [18F]F-FDG PET/CT is widely used for H&N cancer management. Recently, the diffusion model has demonstrated remarkable performance in various image-generation tasks. In this work, we proposed a 3D diffusion model to accurately perform H&N tumor segmentation from 3D PET and CT volumes. The 3D diffusion model was developed considering the 3D nature of PET and CT images acquired. During the reverse process, the model utilized a 3D UNet structure and took the concatenation of PET, CT, and Gaussian noise volumes as the network input to generate the tumor mask. Experiments based on the HECKTOR challenge dataset were conducted to evaluate the effectiveness of the proposed diffusion model. Several state-of-the-art techniques based on U-Net and Transformer structures were adopted as the reference methods. Benefits of employing both PET and CT as the network input as well as further extending the diffusion model from 2D to 3D were investigated based on various quantitative metrics and the uncertainty maps generated. Results showed that the proposed 3D diffusion model could generate more accurate segmentation results compared with other methods. Compared to the diffusion model in 2D format, the proposed 3D model yielded superior results. Our experiments also highlighted the advantage of utilizing dual-modality PET and CT data over only single-modality data for H&N tumor segmentation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 22 of its 32 references that are in the map. First posted on arXiv 31 Jan 2024.

Builds on

22 of 32 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  10. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  11. 2018Group Normalizationcited by 1,514
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
10 more
  1. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  2. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  3. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  4. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  5. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
  6. 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
  7. 2022Medical Image Segmentation Review: The success of U-Netcited by 190
  8. 2020BiO-Net: Learning Recurrent Bi-directional Connections for Encoder-Decoder Architecturecited by 25
  9. 2021Squeeze-and-Excitation Normalization for Automated Delineation of Head and Neck Primary Tumors in Combined PET and CT Imagescited by 20
  10. 2022Spach Transformer: Spatial and Channel-wise Transformer Based on Local and Global Self-attentions for PET Image Denoisingcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023DDPET-3D: Dose-aware Diffusion Model for 3D Ultra Low-dose PET Imaging
  2. 2024Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models
  3. 2024Dose-aware Diffusion Model for 3D PET Image Denoising: Multi-institutional Validation with Reader Study and Real Low-dose Data
  4. 2024Adaptive Whole-Body PET Image Denoising Using 3D Diffusion Models with ControlNet
  5. 2025Supervised Diffusion-Model-Based PET Image Reconstruction
  6. 2026GR-Diffusion: 3D Gaussian Representation Meets Diffusion in Whole-Body PET Reconstruction
  7. 2025Cascaded 3D Diffusion Models for Whole-body 3D 18-F FDG PET/CT synthesis from Demographics
  8. 2023Memory-Efficient 3D Denoising Diffusion Models for Medical Image Processing