Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration
Not on the map. Why?
Abstract (arXiv)
Recent advances in image restoration have enabled high-fidelity recovery of faces from degraded inputs using reference-based face restoration models (Ref-FR). However, such methods focus solely on facial regions, neglecting degradation across the full scene, including body and background, which limits practical usability. Meanwhile, full-scene restorers often ignore degradation cues entirely, leading to underdetermined predictions and visual artifacts. In this work, we propose Face2Scene, a two-stage restoration framework that leverages the face as a perceptual oracle to estimate degradation and guide the restoration of the entire image. Given a degraded image and one or more identity references, we first apply a Ref-FR model to reconstruct high-quality facial details. From the restored-degraded face pair, we extract a face-derived degradation code that captures degradation attributes (e.g., noise, blur, compression), which is then transformed into multi-scale degradation-aware tokens. These tokens condition a diffusion model to restore the full scene in a single step, including the body and background. Extensive experiments demonstrate the superior effectiveness of the proposed method compared to state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
56 of 68 references.
References · 56
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
38 more
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2023Adversarial Diffusion Distillationcited by 759
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
- 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 86
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
- 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
- 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40
- 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 35
- 2022MM-RealSR: Metric Learning based Interactive Modulation for Real-World Super-Resolutioncited by 33
- 2023RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairscited by 33
- 2024OSDFace: One-Step Diffusion Model for Face Restorationcited by 33
- 2023Image Super-Resolution with Text Prompt Diffusioncited by 23
- 2024ReF-LDM: A Latent Diffusion Model for Reference-based Face Image Restorationcited by 16
- 2022From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolutioncited by 15
- 2025Dual Prompting Image Restoration with Diffusion Transformerscited by 15
- 2025FaceMe: Robust Blind Face Restoration with Personal Identificationcited by 14
- 2024PFStorer: Personalized Face Restoration and Super-Resolutioncited by 13
- 2024InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attentioncited by 13
- 2024Overcoming False Illusions in Real-World Face Restoration with Multi-Modal Guided Diffusion Modelcited by 12
- 2024RestorerID: Towards Tuning-Free Face Restoration with ID Preservationcited by 10
- 2023Restoration by Generation with Constrained Priorscited by 9
- 2023Learning Lens Blur Fieldscited by 6
- 2024DiffBody: Human Body Restoration by Imagining with Generative Diffusion Priorcited by 6
- 2025Human Body Restoration with One-Step Diffusion Model and A New Benchmarkcited by 5
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HDRFace: Rethinking Face Restoration with High-Dimensional Representation
- 2026DVFace: Spatio-Temporal Dual-Prior Diffusion for Video Face Restoration
- 2023DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration
- 2024AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior
- 2024DR-BFR: Degradation Representation with Diffusion Models for Blind Face Restoration
- 2023PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance
- 2025Self-Supervised Selective-Guided Diffusion Model for Old-Photo Face Restoration
- 2025Robust ID-Specific Face Restoration via Alignment Learning