mlsanityData to 7 Oct 2026

InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention

arXiv 2412.06753 ↗First posted 9 Dec 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Face image restoration aims to enhance degraded facial images while addressing challenges such as diverse degradation types, real-time processing demands, and, most crucially, the preservation of identity-specific features. Existing methods often struggle with slow processing times and suboptimal restoration, especially under severe degradation, failing to accurately reconstruct finer-level identity details. To address these issues, we introduce InstantRestore, a novel framework that leverages a single-step image diffusion model and an attention-sharing mechanism for fast and personalized face restoration. Additionally, InstantRestore incorporates a novel landmark attention loss, aligning key facial landmarks to refine the attention maps, enhancing identity preservation. At inference time, given a degraded input and a small (~4) set of reference images, InstantRestore performs a single forward pass through the network to achieve near real-time performance. Unlike prior approaches that rely on full diffusion processes or per-identity model tuning, InstantRestore offers a scalable solution suitable for large-scale applications. Extensive experiments demonstrate that InstantRestore outperforms existing methods in quality and speed, making it an appealing choice for identity-preserving face restoration.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 59 of its 86 references that are in the map. First posted on arXiv 9 Dec 2024.

Builds on

59 of 86 references.

References · 59

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  8. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  10. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  11. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
38 more
  1. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  2. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  3. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  4. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  5. 2017The Perception-Distortion Tradeoffcited by 582
  6. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  7. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
  8. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  9. 2023Emergent Correspondence from Image Diffusioncited by 437
  10. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
  11. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  12. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  13. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  14. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 255
  15. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  16. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
  17. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  18. 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
  19. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  20. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
  21. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
  22. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  23. 2024Training-Free Consistent Text-to-Image Generationcited by 123
  24. 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
  25. 2020Blind Face Restoration via Deep Multi-scale Component Dictionariescited by 106
  26. 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
  27. 2018Learning Warped Guidance for Blind Face Restorationcited by 87
  28. 2018Deep Semantic Face Deblurringcited by 80
  29. 2023DR2: Diffusion-based Robust Degradation Remover for Blind Face Restorationcited by 79
  30. 2024Distilling Diffusion Models into Conditional GANscited by 78
  31. 2019Progressive Face Super-Resolution via Attention to Facial Landmarkcited by 73
  32. 2020HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishmentcited by 70
  33. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
  34. 2024MyVLM: Personalizing VLMs for User-Specific Queriescited by 58
  35. 2019Exemplar Guided Face Image Super-Resolution without Facial Landmarkscited by 57
  36. 2017Super-FAN: Integrated facial landmark localization and super-resolution of real-world low resolution faces in arbitrary poses with GANscited by 55
  37. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
  38. 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 8.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024PFStorer: Personalized Face Restoration and Super-Resolution
  2. 2025FaceMe: Robust Blind Face Restoration with Personal Identification
  3. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds
  4. 2024AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior
  5. 2023Personalized Restoration via Dual-Pivot Tuning
  6. 2024RestorerID: Towards Tuning-Free Face Restoration with ID Preservation
  7. 2024OSDFace: One-Step Diffusion Model for Face Restoration
  8. 2025Robust ID-Specific Face Restoration via Alignment Learning