mlsanityData to 7 Oct 2026

TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restoration

arXiv 2601.20306 ↗First posted 28 Jan 2026cs.CVcited by 3

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

All-in-one image restoration aims to address diverse degradation types using a single unified model. Existing methods typically rely on degradation priors to guide restoration, yet often struggle to reconstruct content in severely degraded regions. Although recent works leverage semantic information to facilitate content generation, integrating it into the shallow layers of diffusion models often disrupts spatial structures (e.g., blurring artifacts). To address this issue, we propose a Triple-Prior Guided Diffusion (TPGDiff) network for unified image restoration. TPGDiff incorporates degradation priors throughout the diffusion trajectory, while introducing structural priors into shallow layers and semantic priors into deep layers, enabling hierarchical and complementary prior guidance for image reconstruction. Specifically, we leverage multi-source structural cues as structural priors to capture fine-grained details and guide shallow layers representations. To complement this design, we further develop a distillation-driven semantic extractor that yields robust semantic priors, ensuring reliable high-level guidance at deep layers even under severe degradations. Furthermore, a degradation extractor is employed to learn degradation-aware priors, enabling stage-adaptive control of the diffusion process across all timesteps. Extensive experiments on both single- and multi-degradation benchmarks demonstrate that TPGDiff achieves superior performance and generalization across diverse restoration scenarios. Our project page is: https://leoyjtu.github.io/tpgdiff-project.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 95 of its 128 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

95 of 128 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Model10 Dec
  2. 2025IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models30 May
  3. 2025Dual Prompting Image Restoration with Diffusion Transformers24 Apr
  4. 2025Perceive, Understand and Restore: Real-World Image Super-Resolution with Autoregressive Multimodal Generative Models14 Mar
  5. 2025UniRestore: Unified Perceptual and Task-Oriented Image Restoration Model Using Diffusion Prior22 Jan
  6. 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration4 Jul
  7. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar
  8. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution8 Mar
  9. 2023Restoration by Generation with Constrained Priors28 Dec
  10. 2023SPIRE: Semantic Prompt-Driven Image Restoration18 Dec
  11. 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge16 Dec
  12. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
4 more
  1. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct
  2. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
  3. 2023Residual Denoising Diffusion Models25 Aug
  4. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models29 Jul

Other references · 79

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  9. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  10. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  11. 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
38 more
  1. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  2. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  3. 2021Multi-Stage Progressive Image Restorationcited by 813
  4. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  5. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  6. 2022Simple Baselines for Image Restorationcited by 701
  7. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  8. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  9. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  10. 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
  11. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  12. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 271
  13. 2022Vision Transformers for Single Image Dehazingcited by 255
  14. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  15. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  16. 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
  17. 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 228
  18. 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
  19. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  20. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  21. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  22. 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 182
  23. 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
  24. 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 139
  25. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  26. 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
  27. 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
  28. 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
  29. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
  30. 2018Gated Context Aggregation Network for Image Dehazing and Derainingcited by 89
  31. 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
  32. 2022Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesiscited by 85
  33. 2023Low-Light Image Enhancement via Structure Modeling and Guidancecited by 78
  34. 2023ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restorationcited by 77
  35. 2019A General Decoupled Learning Framework for Parameterized Image Operatorscited by 72
  36. 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 60
  37. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  38. 2023Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancementcited by 57

50 most cited of 79 All 79 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UniLDiff: Unlocking the Power of Diffusion Priors for All-in-One Image Restoration
  2. 2022Multiscale Structure Guided Diffusion for Image Deblurring
  3. 2023A Unified Conditional Framework for Diffusion-based Image Restoration
  4. 2024Decoupled Data Consistency with Diffusion Purification for Image Restoration
  5. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement
  6. 2025Exploiting Diffusion Prior for Task-driven Image Restoration
  7. 2023PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance
  8. 2024SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration