InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention
Not on the map. Why?
Abstract (arXiv)
Face image restoration aims to enhance degraded facial images while addressing challenges such as diverse degradation types, real-time processing demands, and, most crucially, the preservation of identity-specific features. Existing methods often struggle with slow processing times and suboptimal restoration, especially under severe degradation, failing to accurately reconstruct finer-level identity details. To address these issues, we introduce InstantRestore, a novel framework that leverages a single-step image diffusion model and an attention-sharing mechanism for fast and personalized face restoration. Additionally, InstantRestore incorporates a novel landmark attention loss, aligning key facial landmarks to refine the attention maps, enhancing identity preservation. At inference time, given a degraded input and a small (~4) set of reference images, InstantRestore performs a single forward pass through the network to achieve near real-time performance. Unlike prior approaches that rely on full diffusion processes or per-identity model tuning, InstantRestore offers a scalable solution suitable for large-scale applications. Extensive experiments demonstrate that InstantRestore outperforms existing methods in quality and speed, making it an appealing choice for identity-preserving face restoration.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 59 of its 86 references that are in the map. First posted on arXiv 9 Dec 2024.
Builds on
59 of 86 references.
References · 59
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
38 more
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2017The Perception-Distortion Tradeoffcited by 582
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 255
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2024Training-Free Consistent Text-to-Image Generationcited by 123
- 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
- 2020Blind Face Restoration via Deep Multi-scale Component Dictionariescited by 106
- 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
- 2018Learning Warped Guidance for Blind Face Restorationcited by 87
- 2018Deep Semantic Face Deblurringcited by 80
- 2023DR2: Diffusion-based Robust Degradation Remover for Blind Face Restorationcited by 79
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2019Progressive Face Super-Resolution via Attention to Facial Landmarkcited by 73
- 2020HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishmentcited by 70
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
- 2024MyVLM: Personalizing VLMs for User-Specific Queriescited by 58
- 2019Exemplar Guided Face Image Super-Resolution without Facial Landmarkscited by 57
- 2017Super-FAN: Integrated facial landmark localization and super-resolution of real-world low resolution faces in arbitrary poses with GANscited by 55
- 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
- 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 8.
13 papers.
Sort:
By area:
- 2025NTIRE 2025 Challenge on Real-World Face Restoration: Methods and Resultscited by 10
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modelingcited by 5
- 2025Reference-Guided Identity Preserving Face Restorationcited by 2
- 2026RenderFlow: Single-Step Neural Rendering via Flow Matchingcited by 2
- 2025HonestFace: Towards Honest Face Restoration with One-Step Diffusion Modelcited by 1
- 2025RefSTAR: Blind Facial Image Restoration with Reference Selection, Transfer, and Reconstructioncited by 1
- 2025HeadsUp! High-Fidelity Portrait Image Super-Resolutioncited by 0
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restorationcited by 0
- 2026MeInTime: Bridging Age Gap in Identity-Preserving Face Restorationcited by 0
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Planecited by 0
- 2026TimeWeaver: Age-Consistent Reference-Based Face Restoration with Identity Preservationcited by 0
- 2026RGFVR: Reference-Guided Face Video Restoration with Flow Matchingcited by 0
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation29 Sep 2026
- 2026RGFVR: Reference-Guided Face Video Restoration with Flow Matching15 Jun 2026
- 2026TimeWeaver: Age-Consistent Reference-Based Face Restoration with Identity Preservation24 Mar 2026
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane20 Mar 2026
- 2026MeInTime: Bridging Age Gap in Identity-Preserving Face Restoration19 Mar 2026
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration17 Mar 2026
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling2 Feb 2026
- 2026RenderFlow: Single-Step Neural Rendering via Flow Matching11 Jan 2026
- 2025HeadsUp! High-Fidelity Portrait Image Super-Resolution10 Oct 2025
- 2025RefSTAR: Blind Facial Image Restoration with Reference Selection, Transfer, and Reconstruction14 Jul 2025
- 2025Reference-Guided Identity Preserving Face Restoration28 May 2025
- 2025HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model24 May 2025
1 more
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modelingcited by 5
- 2025Reference-Guided Identity Preserving Face Restorationcited by 2
- 2026RenderFlow: Single-Step Neural Rendering via Flow Matchingcited by 2
- 2025HonestFace: Towards Honest Face Restoration with One-Step Diffusion Modelcited by 1
- 2025HeadsUp! High-Fidelity Portrait Image Super-Resolutioncited by 0
- 2026RGFVR: Reference-Guided Face Video Restoration with Flow Matchingcited by 0
- 2026RGFVR: Reference-Guided Face Video Restoration with Flow Matching15 Jun 2026
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling2 Feb 2026
- 2026RenderFlow: Single-Step Neural Rendering via Flow Matching11 Jan 2026
- 2025HeadsUp! High-Fidelity Portrait Image Super-Resolution10 Oct 2025
- 2025Reference-Guided Identity Preserving Face Restoration28 May 2025
- 2025HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model24 May 2025
- 2025NTIRE 2025 Challenge on Real-World Face Restoration: Methods and Resultscited by 10
- 2025RefSTAR: Blind Facial Image Restoration with Reference Selection, Transfer, and Reconstructioncited by 1
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restorationcited by 0
- 2026MeInTime: Bridging Age Gap in Identity-Preserving Face Restorationcited by 0
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Planecited by 0
- 2026TimeWeaver: Age-Consistent Reference-Based Face Restoration with Identity Preservationcited by 0
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animationcited by 0
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation29 Sep 2026
- 2026TimeWeaver: Age-Consistent Reference-Based Face Restoration with Identity Preservation24 Mar 2026
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane20 Mar 2026
- 2026MeInTime: Bridging Age Gap in Identity-Preserving Face Restoration19 Mar 2026
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration17 Mar 2026
- 2025RefSTAR: Blind Facial Image Restoration with Reference Selection, Transfer, and Reconstruction14 Jul 2025
- 2025NTIRE 2025 Challenge on Real-World Face Restoration: Methods and Results20 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024PFStorer: Personalized Face Restoration and Super-Resolution
- 2025FaceMe: Robust Blind Face Restoration with Personal Identification
- 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds
- 2024AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior
- 2023Personalized Restoration via Dual-Pivot Tuning
- 2024RestorerID: Towards Tuning-Free Face Restoration with ID Preservation
- 2024OSDFace: One-Step Diffusion Model for Face Restoration
- 2025Robust ID-Specific Face Restoration via Alignment Learning