# PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance

arXiv: https://arxiv.org/abs/2309.10810 · HTML: https://mlsanity.com/paper/2309.10810/

## Key facts

- Cited by 49 papers in the map (data through 14 Oct 2026).
- Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models.
- Builds on 42 of its 49 references that are in the map.
- First posted on arXiv 19 Sep 2023.

## Placed in

- Diffusion models / [Inverse problems and image restoration](https://mlsanity.com/diffusion/inverse-problems-and-image-restoration/)

## Builds on (most cited first, 30 of 42)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [ImageNet Large Scale Visual Recognition Challenge](https://mlsanity.com/paper/1409.0575/) (2014)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Neural Discrete Representation Learning](https://mlsanity.com/paper/1711.00937/) (2017)
- [Analyzing and Improving the Image Quality of StyleGAN](https://mlsanity.com/paper/1912.04958/) (2019)
- [Taming Transformers for High-Resolution Image Synthesis](https://mlsanity.com/paper/2012.09841/) (2020)
- [Progressive Growing of GANs for Improved Quality, Stability, and Variation](https://mlsanity.com/paper/1710.10196/) (2017)
- [Perceptual Losses for Real-Time Style Transfer and Super-Resolution](https://mlsanity.com/paper/1603.08155/) (2016)
- [Large Scale GAN Training for High Fidelity Natural Image Synthesis](https://mlsanity.com/paper/1809.11096/) (2018)
- [Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network](https://mlsanity.com/paper/1609.04802/) (2016)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network](https://mlsanity.com/paper/1609.05158/) (2016)
- [MUSIQ: Multi-scale Image Quality Transformer](https://mlsanity.com/paper/2108.05997/) (2021)
- [Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data](https://mlsanity.com/paper/2107.10833/) (2021)
- [Denoising Diffusion Restoration Models](https://mlsanity.com/paper/2201.11793/) (2022)
- [Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models](https://mlsanity.com/paper/2301.13826/) (2023)
- [Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model](https://mlsanity.com/paper/2212.00490/) (2022)
- [Exploiting Diffusion Prior for Real-World Image Super-Resolution](https://mlsanity.com/paper/2305.07015/) (2023)
- [PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models](https://mlsanity.com/paper/2003.03808/) (2020)
- [Towards Real-World Blind Face Restoration with Generative Facial Prior](https://mlsanity.com/paper/2101.04061/) (2021)
- [Towards Robust Blind Face Restoration with Codebook Lookup Transformer](https://mlsanity.com/paper/2206.11253/) (2022)
- [Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation](https://mlsanity.com/paper/2003.13659/) (2020)
- [Generative Diffusion Prior for Unified Image Restoration and Enhancement](https://mlsanity.com/paper/2304.01247/) (2023)

## Built on by (most cited first, 30 of 49)

- [Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution](https://mlsanity.com/paper/2312.06640/) (2023)
- [Deepfake Generation and Detection: A Benchmark and Survey](https://mlsanity.com/paper/2403.17881/) (2024)
- [DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models](https://mlsanity.com/paper/2407.01519/) (2024)
- [OSDFace: One-Step Diffusion Model for Face Restoration](https://mlsanity.com/paper/2411.17163/) (2024)
- [Survey on Deep Face Restoration: From Non-blind to Blind and Beyond](https://mlsanity.com/paper/2309.15490/) (2023)
- [AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement](https://mlsanity.com/paper/2407.14900/) (2024)
- [Osmosis: RGBD Diffusion Prior for Underwater Image Restoration](https://mlsanity.com/paper/2403.14837/) (2024)
- [Precise Object and Effect Removal with Adaptive Target-Aware Attention](https://mlsanity.com/paper/2505.22636/) (2025)
- [The Second Challenge on Real-World Face Restoration at NTIRE 2026: Methods and Results](https://mlsanity.com/paper/2604.10532/) (2026)
- [NTIRE 2025 Challenge on Real-World Face Restoration: Methods and Results](https://mlsanity.com/paper/2504.14600/) (2025)
- [InterLCM: Low-Quality Images as Intermediate States of Latent Consistency Models for Effective Blind Face Restoration](https://mlsanity.com/paper/2502.02215/) (2025)
- [Visual Style Prompt Learning Using Diffusion Models for Blind Face Restoration](https://mlsanity.com/paper/2412.21042/) (2024)
- [Self-Supervised Selective-Guided Diffusion Model for Old-Photo Face Restoration](https://mlsanity.com/paper/2510.12114/) (2025)
- [Synthetic to Authentic: Transferring Realism to 3D Face Renderings for Boosting Face Recognition](https://mlsanity.com/paper/2407.07627/) (2024)
- [Diffusion Prior Interpolation for Flexibility Real-World Face Super-Resolution](https://mlsanity.com/paper/2412.16552/) (2024)
- [Taming Generative Diffusion Prior for Universal Blind Image Restoration](https://mlsanity.com/paper/2408.11287/) (2024)
- [AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior](https://mlsanity.com/paper/2410.09864/) (2024)
- [Zero-Shot Low Light Image Enhancement with Diffusion Prior](https://mlsanity.com/paper/2412.13401/) (2024)
- [INDIGO+: A Unified INN-Guided Probabilistic Diffusion Algorithm for Blind and Non-Blind Image Restoration](https://mlsanity.com/paper/2501.14014/) (2025)
- [Robust ID-Specific Face Restoration via Alignment Learning](https://mlsanity.com/paper/2507.10943/) (2025)
- [Towards Unsupervised Blind Face Restoration using Diffusion Prior](https://mlsanity.com/paper/2410.04618/) (2024)
- [Reference-Guided Identity Preserving Face Restoration](https://mlsanity.com/paper/2505.21905/) (2025)
- [DynFaceRestore: Balancing Fidelity and Quality in Diffusion-Guided Blind Face Restoration with Dynamic Blur-Level Mapping and Guidance](https://mlsanity.com/paper/2507.13797/) (2025)
- [Unlocking the Potential of Diffusion Priors in Blind Face Restoration](https://mlsanity.com/paper/2508.08556/) (2025)
- [NanoSD: Edge Efficient Foundation Model for Real Time Image Restoration](https://mlsanity.com/paper/2601.09823/) (2026)
- [Lipschitz-Driven Noise Robustness in VQ-AE for High-Frequency Texture Repair in ID-Specific Talking Heads](https://mlsanity.com/paper/2410.00990/) (2024)
- [HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model](https://mlsanity.com/paper/2505.18469/) (2025)
- [DicFace: Dirichlet-Constrained Variational Codebook Learning for Temporally Coherent Video Face Restoration](https://mlsanity.com/paper/2506.13355/) (2025)
- [RefSTAR: Blind Facial Image Restoration with Reference Selection, Transfer, and Reconstruction](https://mlsanity.com/paper/2507.10470/) (2025)
- [Personalized Face Super-Resolution with Identity Decoupling and Fitting](https://mlsanity.com/paper/2508.10937/) (2025)

## Abstract (arXiv)

Exploiting pre-trained diffusion models for restoration has recently become a favored alternative to the traditional task-specific training approach. Previous works have achieved noteworthy success by limiting the solution space using explicit degradation models. However, these methods often fall short when faced with complex degradations as they generally cannot be precisely modeled. In this paper, we propose PGDiff by introducing partial guidance, a fresh perspective that is more adaptable to real-world degradations compared to existing works. Rather than specifically defining the degradation process, our approach models the desired properties, such as image structure and color statistics of high-quality images, and applies this guidance during the reverse diffusion process. These properties are readily available and make no assumptions about the degradation process. When combined with a diffusion prior, this partial guidance can deliver appealing results across a range of restoration tasks. Additionally, PGDiff can be extended to handle composite tasks by consolidating multiple high-quality image properties, achieved by integrating the guidance from respective tasks. Experimental results demonstrate that our method not only outperforms existing diffusion-prior-based approaches but also competes favorably with task-specific models.