IQPFR: An Image Quality Prior for Blind Face Restoration and Beyond
Not on the map. Why?
Abstract (arXiv)
Blind Face Restoration (BFR) addresses the challenge of reconstructing degraded low-quality (LQ) facial images into high-quality (HQ) outputs. Conventional approaches predominantly rely on learning feature representations from ground-truth (GT) data; however, inherent imperfections in GT datasets constrain restoration performance to the mean quality level of the training data, rather than attaining maximally attainable visual quality. To overcome this limitation, we propose a novel framework that incorporates an Image Quality Prior (IQP) derived from No-Reference Image Quality Assessment (NR-IQA) models to guide the restoration process toward optimal HQ reconstructions. Our methodology synergizes this IQP with a learned codebook prior through two critical innovations: (1) During codebook learning, we devise a dual-branch codebook architecture that disentangles feature extraction into universal structural components and HQ-specific attributes, ensuring comprehensive representation of both common and high-quality facial characteristics. (2) In the codebook lookup stage, we implement a quality-conditioned Transformer-based framework. NR-IQA-derived quality scores act as dynamic conditioning signals to steer restoration toward the highest feasible quality standard. This score-conditioned paradigm enables plug-and-play enhancement of existing BFR architectures without modifying the original structure. We also formulate a discrete representation-based quality optimization strategy that circumvents over-optimization artifacts prevalent in continuous latent space approaches. Extensive experiments demonstrate that our method outperforms state-of-the-art techniques across multiple benchmarks. Besides, our quality-conditioned framework demonstrates consistent performance improvements when integrated with prior BFR models. The code will be released.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 46 of its 56 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
46 of 56 references.
References · 46
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
34 more
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
- 2023Reward Model Ensembles Help Mitigate Overoptimizationcited by 231
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
- 2023End-to-End Diffusion Latent Optimization Improves Classifier Guidancecited by 108
- 2020Blind Face Restoration via Deep Multi-scale Component Dictionariescited by 106
- 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
- 2022DifFace: Blind Face Restoration with Diffused Error Contractioncited by 97
- 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 89
- 2018Learning Warped Guidance for Blind Face Restorationcited by 87
- 2022RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairscited by 85
- 2023DR2: Diffusion-based Robust Degradation Remover for Blind Face Restorationcited by 79
- 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
- 2019Progressive Face Super-Resolution via Attention to Facial Landmarkcited by 73
- 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
- 2022Underwater Ranker: Learn Which Is Better and How to Be Bettercited by 67
- 2019Exemplar Guided Face Image Super-Resolution without Facial Landmarkscited by 57
- 2022Uncertainty Inspired Underwater Image Enhancementcited by 54
- 2020Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimationcited by 53
- 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
- 2015Learning to Generate Images with Perceptual Similarity Metricscited by 39
- 2022GCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priorscited by 39
- 2017Aesthetic-Driven Image Enhancement by Adversarial Learningcited by 38
- 2020Face Super-Resolution Guided by 3D Facial Priorscited by 38
- 2023HQG-Net: Unpaired Medical Image Enhancement with High-Quality Guidancecited by 36
- 2023Dual Associated Encoder for Face Restorationcited by 23
- 2022Going the Extra Mile in Face Image Quality Assessment: A Novel Database and Modelcited by 22
- 2024WaveFace: Authentic Face Restoration with Efficient Frequency Recoverycited by 20
- 2023Towards Authentic Face Restoration with Iterative Diffusion Models and Beyondcited by 18
- 2023DiffBFR: Bootstrapping Diffusion Model Towards Blind Face Restorationcited by 17
- 2022Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restorationcited by 12
- 2024Opinion-Unaware Blind Image Quality Assessment using Multi-Scale Deep Feature Statisticscited by 11
- 2025InterLCM: Low-Quality Images as Intermediate States of Latent Consistency Models for Effective Blind Face Restorationcited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinementcited by 11
- 2025MILO: A Lightweight Perceptual Quality Metric for Image and Latent-Space Optimizationcited by 3
- 2026Beyond Ground-Truth: Leveraging Image Quality Priors for Real-World Image Restorationcited by 3
- 2026Beyond Ground-Truth: Leveraging Image Quality Priors for Real-World Image Restoration31 Mar 2026
- 2025MILO: A Lightweight Perceptual Quality Metric for Image and Latent-Space Optimization1 Sep 2025
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinement20 Aug 2025