mlsanityData to 7 Oct 2026

st-DTPM: Spatial-Temporal Guided Diffusion Transformer Probabilistic Model for Delayed Scan PET Image Prediction

arXiv 2410.22732 ↗First posted 30 Oct 2024eess.IV cs.AI cs.CVcited by 1

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

PET imaging is widely employed for observing biological metabolic activities within the human body. However, numerous benign conditions can cause increased uptake of radiopharmaceuticals, confounding differentiation from malignant tumors. Several studies have indicated that dual-time PET imaging holds promise in distinguishing between malignant and benign tumor processes. Nevertheless, the hour-long distribution period of radiopharmaceuticals post-injection complicates the determination of optimal timing for the second scan, presenting challenges in both practical applications and research. Notably, we have identified that delay time PET imaging can be framed as an image-to-image conversion problem. Motivated by this insight, we propose a novel spatial-temporal guided diffusion transformer probabilistic model (st-DTPM) to solve dual-time PET imaging prediction problem. Specifically, this architecture leverages the U-net framework that integrates patch-wise features of CNN and pixel-wise relevance of Transformer to obtain local and global information. And then employs a conditional DDPM model for image synthesis. Furthermore, on spatial condition, we concatenate early scan PET images and noisy PET images on every denoising step to guide the spatial distribution of denoising sampling. On temporal condition, we convert diffusion time steps and delay time to a universal time vector, then embed it to each layer of model architecture to further improve the accuracy of predictions. Experimental results demonstrated the superiority of our method over alternative approaches in preserving image quality and structural information, thereby affirming its efficacy in predictive task.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 31 of its 62 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

31 of 62 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024DP-MDM: Detail-Preserving MR Reconstruction via Multiple Diffusion Models9 May
  2. 2022PET image denoising based on denoising diffusion probabilistic models13 Sep

Other references · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  11. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
17 more
  1. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  2. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  3. 2017Deep Image Priorcited by 1,097
  4. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  5. 2019Deep Learning for Image Super-resolution: A Surveycited by 368
  6. 2017Toward Multimodal Image-to-Image Translationcited by 295
  7. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 260
  8. 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
  9. 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
  10. 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
  11. 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
  12. 2021Image-to-Image Translation: Methods and Applicationscited by 116
  13. 2023DiffiT: Diffusion Vision Transformers for Image Generationcited by 104
  14. 2020Transforming and Projecting Images into Class-conditional Generative Networkscited by 76
  15. 2017CVAE-GAN: Fine-Grained Image Generation through Asymmetric Trainingcited by 42
  16. 2019Conditional GANs For Painting Generationcited by 3
  17. 2024TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correctioncited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion Transformer Model With Compact Prior for Low-dose PET Reconstruction
  2. 2025Supervised Diffusion-Model-Based PET Image Reconstruction
  3. 2026Delta-Diffusion: Modeling Longitudinal Brain Amyloid-PET Trajectories via Conditional Poisson Diffusion Bridge
  4. 2025PET Tracer Separation Using Conditional Diffusion Transformer with Multi-latent Space Learning
  5. 2025Diffusion Transformer Meets Random Masks: An Advanced PET Reconstruction Framework
  6. 2024Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models
  7. 2024LegoPET: Hierarchical Feature Guided Conditional Diffusion for PET Image Reconstruction
  8. 2024Dose-aware Diffusion Model for 3D PET Image Denoising: Multi-institutional Validation with Reader Study and Real Low-dose Data