# OSDFace: One-Step Diffusion Model for Face Restoration

arXiv: https://arxiv.org/abs/2411.17163 · HTML: https://mlsanity.com/paper/2411.17163/

## Key facts

- Cited by 33 papers in the map (data through 14 Oct 2026).
- Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models.
- Builds on 63 of its 78 references that are in the map.
- First posted on arXiv 26 Nov 2024.

## Placed in

- Diffusion models / [Inverse problems and image restoration](https://mlsanity.com/diffusion/inverse-problems-and-image-restoration/)

## Builds on (most cited first, 30 of 63)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Denoising Diffusion Implicit Models](https://mlsanity.com/paper/2010.02502/) (2020)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding](https://mlsanity.com/paper/2205.11487/) (2022)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Neural Discrete Representation Learning](https://mlsanity.com/paper/1711.00937/) (2017)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Taming Transformers for High-Resolution Image Synthesis](https://mlsanity.com/paper/2012.09841/) (2020)
- [Progressive Growing of GANs for Improved Quality, Stability, and Variation](https://mlsanity.com/paper/1710.10196/) (2017)
- [FaceNet: A Unified Embedding for Face Recognition and Clustering](https://mlsanity.com/paper/1503.03832/) (2015)
- [Perceptual Losses for Real-Time Style Transfer and Super-Resolution](https://mlsanity.com/paper/1603.08155/) (2016)
- [Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation](https://mlsanity.com/paper/1308.3432/) (2013)
- [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization](https://mlsanity.com/paper/1703.06868/) (2017)
- [Consistency Models](https://mlsanity.com/paper/2303.01469/) (2023)
- [MUSIQ: Multi-scale Image Quality Transformer](https://mlsanity.com/paper/2108.05997/) (2021)
- [One-step Diffusion with Distribution Matching Distillation](https://mlsanity.com/paper/2311.18828/) (2023)
- [Exploring CLIP for Assessing the Look and Feel of Images](https://mlsanity.com/paper/2207.12396/) (2022)
- [Denoising Diffusion Restoration Models](https://mlsanity.com/paper/2201.11793/) (2022)
- [Image Quality Assessment: Unifying Structure and Texture Similarity](https://mlsanity.com/paper/2004.07728/) (2020)
- [SphereFace: Deep Hypersphere Embedding for Face Recognition](https://mlsanity.com/paper/1704.08063/) (2017)
- [Improved Distribution Matching Distillation for Fast Image Synthesis](https://mlsanity.com/paper/2405.14867/) (2024)
- [Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model](https://mlsanity.com/paper/2212.00490/) (2022)
- [MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment](https://mlsanity.com/paper/2204.08958/) (2022)
- [PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models](https://mlsanity.com/paper/2003.03808/) (2020)
- [Towards Real-World Blind Face Restoration with Generative Facial Prior](https://mlsanity.com/paper/2101.04061/) (2021)

## Built on by (most cited first, 30 of 33)

- [The Second Challenge on Real-World Face Restoration at NTIRE 2026: Methods and Results](https://mlsanity.com/paper/2604.10532/) (2026)
- [MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillation](https://mlsanity.com/paper/2507.04290/) (2025)
- [NTIRE 2025 Challenge on Real-World Face Restoration: Methods and Results](https://mlsanity.com/paper/2504.14600/) (2025)
- [Self-Supervised Selective-Guided Diffusion Model for Old-Photo Face Restoration](https://mlsanity.com/paper/2510.12114/) (2025)
- [Human Body Restoration with One-Step Diffusion Model and A New Benchmark](https://mlsanity.com/paper/2502.01411/) (2025)
- [HAODiff: Human-Aware One-Step Diffusion via Dual-Prompt Guidance](https://mlsanity.com/paper/2505.19742/) (2025)
- [FlashEdit: Decoupling Speed, Structure, and Semantics for Precise Image Editing](https://mlsanity.com/paper/2509.22244/) (2025)
- [FideDiff: Efficient Diffusion Model for High-Fidelity Image Motion Deblurring](https://mlsanity.com/paper/2510.01641/) (2025)
- [NanoSD: Edge Efficient Foundation Model for Real Time Image Restoration](https://mlsanity.com/paper/2601.09823/) (2026)
- [Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution](https://mlsanity.com/paper/2603.06275/) (2026)
- [HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model](https://mlsanity.com/paper/2505.18469/) (2025)
- [FADPNet: Frequency-Aware Dual-Path Network for Face Super-Resolution](https://mlsanity.com/paper/2506.14121/) (2025)
- [RefSTAR: Blind Facial Image Restoration with Reference Selection, Transfer, and Reconstruction](https://mlsanity.com/paper/2507.10470/) (2025)
- [PASDiff: Physics-Aware Semantic Guidance for Joint Real-World Low-Light Face Enhancement and Restoration](https://mlsanity.com/paper/2603.24969/) (2026)
- [PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution](https://mlsanity.com/paper/2605.13027/) (2026)
- [Eye-See-You: Reverse Pass-Through VR and Head Avatars](https://mlsanity.com/paper/2505.18869/) (2025)
- [LAFR: Efficient Diffusion-based Blind Face Restoration via Latent Codebook Alignment Adapter](https://mlsanity.com/paper/2505.23462/) (2025)
- [QuantFace: Efficient Quantization for Face Restoration](https://mlsanity.com/paper/2506.00820/) (2025)
- [HeadsUp! High-Fidelity Portrait Image Super-Resolution](https://mlsanity.com/paper/2510.09924/) (2025)
- [LCUDiff: Latent Capacity Upgrade Diffusion for Faithful Human Body Restoration](https://mlsanity.com/paper/2602.04406/) (2026)
- [You Only Need One Stage: Novel-View Synthesis From A Single Blind Face Image](https://mlsanity.com/paper/2603.01328/) (2026)
- [Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration](https://mlsanity.com/paper/2603.16570/) (2026)
- [MeInTime: Bridging Age Gap in Identity-Preserving Face Restoration](https://mlsanity.com/paper/2603.18645/) (2026)
- [TimeWeaver: Age-Consistent Reference-Based Face Restoration with Identity Preservation](https://mlsanity.com/paper/2603.22701/) (2026)
- [A2BFR: Attribute-Aware Blind Face Restoration](https://mlsanity.com/paper/2603.29423/) (2026)
- [AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing](https://mlsanity.com/paper/2604.21289/) (2026)
- [IdentiFace: Multi-Modal Iterative Diffusion Framework for Identifiable Suspect Face Generation in Crime Investigations](https://mlsanity.com/paper/2605.00526/) (2026)
- [IConFace: Fine-Grained Identity Conditioning for Reference-Aware Face Restoration](https://mlsanity.com/paper/2605.02814/) (2026)
- [HDRFace: Rethinking Face Restoration with High-Dimensional Representation](https://mlsanity.com/paper/2605.14821/) (2026)
- [RGFVR: Reference-Guided Face Video Restoration with Flow Matching](https://mlsanity.com/paper/2606.16401/) (2026)

## Abstract (arXiv)

Diffusion models have demonstrated impressive performance in face restoration. Yet, their multi-step inference process remains computationally intensive, limiting their applicability in real-world scenarios. Moreover, existing methods often struggle to generate face images that are harmonious, realistic, and consistent with the subject's identity. In this work, we propose OSDFace, a novel one-step diffusion model for face restoration. Specifically, we propose a visual representation embedder (VRE) to better capture prior information and understand the input face. In VRE, low-quality faces are processed by a visual tokenizer and subsequently embedded with a vector-quantized dictionary to generate visual prompts. Additionally, we incorporate a facial identity loss derived from face recognition to further ensure identity consistency. We further employ a generative adversarial network (GAN) as a guidance model to encourage distribution alignment between the restored face and the ground truth. Experimental results demonstrate that OSDFace surpasses current state-of-the-art (SOTA) methods in both visual quality and quantitative metrics, generating high-fidelity, natural face images with high identity consistency. The code and model will be released at https://github.com/jkwang28/OSDFace.
