mlsanityData to 14 Oct 2026

Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration

arXiv 2603.16570 ↗First posted 17 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in image restoration have enabled high-fidelity recovery of faces from degraded inputs using reference-based face restoration models (Ref-FR). However, such methods focus solely on facial regions, neglecting degradation across the full scene, including body and background, which limits practical usability. Meanwhile, full-scene restorers often ignore degradation cues entirely, leading to underdetermined predictions and visual artifacts. In this work, we propose Face2Scene, a two-stage restoration framework that leverages the face as a perceptual oracle to estimate degradation and guide the restoration of the entire image. Given a degraded image and one or more identity references, we first apply a Ref-FR model to reconstruct high-quality facial details. From the restored-degraded face pair, we extract a face-derived degradation code that captures degradation attributes (e.g., noise, blur, compression), which is then transformed into multi-scale degradation-aware tokens. These tokens condition a diffusion model to restore the full scene in a single step, including the body and background. Extensive experiments demonstrate the superior effectiveness of the proposed method compared to state-of-the-art methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

56 of 68 references.

References · 56

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
38 more
  1. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  2. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  4. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  5. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  6. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  7. 2023Adversarial Diffusion Distillationcited by 759
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  9. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  10. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  11. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
  12. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  13. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
  14. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
  15. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
  16. 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
  17. 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 86
  18. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
  19. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
  20. 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
  21. 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40
  22. 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 35
  23. 2022MM-RealSR: Metric Learning based Interactive Modulation for Real-World Super-Resolutioncited by 33
  24. 2023RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairscited by 33
  25. 2024OSDFace: One-Step Diffusion Model for Face Restorationcited by 33
  26. 2023Image Super-Resolution with Text Prompt Diffusioncited by 23
  27. 2024ReF-LDM: A Latent Diffusion Model for Reference-based Face Image Restorationcited by 16
  28. 2022From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolutioncited by 15
  29. 2025Dual Prompting Image Restoration with Diffusion Transformerscited by 15
  30. 2025FaceMe: Robust Blind Face Restoration with Personal Identificationcited by 14
  31. 2024PFStorer: Personalized Face Restoration and Super-Resolutioncited by 13
  32. 2024InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attentioncited by 13
  33. 2024Overcoming False Illusions in Real-World Face Restoration with Multi-Modal Guided Diffusion Modelcited by 12
  34. 2024RestorerID: Towards Tuning-Free Face Restoration with ID Preservationcited by 10
  35. 2023Restoration by Generation with Constrained Priorscited by 9
  36. 2023Learning Lens Blur Fieldscited by 6
  37. 2024DiffBody: Human Body Restoration by Imagining with Generative Diffusion Priorcited by 6
  38. 2025Human Body Restoration with One-Step Diffusion Model and A New Benchmarkcited by 5

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HDRFace: Rethinking Face Restoration with High-Dimensional Representation
  2. 2026DVFace: Spatio-Temporal Dual-Prior Diffusion for Video Face Restoration
  3. 2023DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration
  4. 2024AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior
  5. 2024DR-BFR: Degradation Representation with Diffusion Models for Blind Face Restoration
  6. 2023PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance
  7. 2025Self-Supervised Selective-Guided Diffusion Model for Old-Photo Face Restoration
  8. 2025Robust ID-Specific Face Restoration via Alignment Learning