RGFVR: Reference-Guided Face Video Restoration with Flow Matching
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Face video restoration from degraded observations is challenging, as it requires simultaneously recovering visual fidelity, temporal consistency, and subject identity. Existing approaches are often either reference-free, which can lead to identity loss when person-specific facial details are lost, or subject-specific, which limits generalization to unseen identities. We propose a subject-agnostic, reference-guided framework for identity-preserving face video restoration. Our method introduces bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator and employs a two-stage training strategy to strengthen identity guidance during restoration. Experiments show that our approach improves restoration fidelity, temporal consistency, and identity preservation, achieving superior performance under challenging video degradations, including downsampling, blur, noise, and compression artifacts. The code is available under: https://github.com/batuhanntosun/RG-FVR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 51 of its 59 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
51 of 59 references.
Closest ancestors · 6
Same direction, newest first
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restoration2 Jan
- 2024ReF-LDM: A Latent Diffusion Model for Reference-based Face Image Restoration6 Dec
- 2024OSDFace: One-Step Diffusion Model for Face Restoration26 Nov
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution11 Dec
- 2023Enhancing Perceptual Quality in Video Super-Resolution through Temporally-Consistent Detail Synthesis using Diffusion Models27 Nov
- 2022DifFace: Blind Face Restoration with Diffused Error Contraction13 Dec
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
33 more
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 334
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
- 2022VRT: A Video Restoration Transformercited by 220
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2022VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decodercited by 116
- 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
- 2018Learning Warped Guidance for Blind Face Restorationcited by 87
- 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40
- 2020Face Super-Resolution Guided by 3D Facial Priorscited by 38
- 2024PFStorer: Personalized Face Restoration and Super-Resolutioncited by 13
- 2024InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attentioncited by 13
- 2025Show and Polish: Reference-Guided Identity Preservation in Face Video Restorationcited by 12
- 2024Beyond Alignment: Blind Video Face Restoration via Parsing-Guided Temporal-Coherent Transformercited by 11
- 2024Kalman-Inspired Feature Propagation for Video Face Super-Resolutioncited by 10
- 2024RestorerID: Towards Tuning-Free Face Restoration with ID Preservationcited by 10
- 2024Towards Real-world Video Face Restoration: A New Benchmarkcited by 6
- 2025SVFR: A Unified Framework for Generalized Video Face Restorationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reference-Guided Identity Preserving Face Restoration
- 2026TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration
- 2026DVFace: Spatio-Temporal Dual-Prior Diffusion for Video Face Restoration
- 2025FaceMe: Robust Blind Face Restoration with Personal Identification
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement
- 2026Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration
- 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration
- 2026FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration