mlsanityData to 7 Oct 2026

VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution

arXiv 2205.03409 ↗First posted 6 May 2022eess.IV cs.AI cs.CVcited by 174

Not on the map. Why?

Cited by 42 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Most of the existing video face super-resolution (VFSR) methods are trained and evaluated on VoxCeleb1, which is designed specifically for speaker identification and the frames in this dataset are of low quality. As a consequence, the VFSR models trained on this dataset can not output visual-pleasing results. In this paper, we develop an automatic and scalable pipeline to collect a high-quality video face dataset (VFHQ), which contains over 16,000 high-fidelity clips of diverse interview scenarios. To verify the necessity of VFHQ, we further conduct experiments and demonstrate that VFSR models trained on our VFHQ dataset can generate results with sharper edges and finer textures than those trained on VoxCeleb1. In addition, we show that the temporal information plays a pivotal role in eliminating video consistency issues as well as further improving visual performance. Based on VFHQ, by analyzing the benchmarking study of several state-of-the-art algorithms under bicubic and blind settings. See our project page: https://liangbinxie.github.io/projects/vfhq

Key facts. Cited by 174 papers in the map (data through 7 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 6 May 2022.

Builds on

33 of 50 references.

References · 33

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  3. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  4. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  5. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  6. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  7. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  8. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  9. 2016Simple Online and Realtime Trackingcited by 862
  10. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  11. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  12. 2017Video Enhancement with Task-Oriented Flowcited by 612
21 more
  1. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
  2. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  3. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 303
  4. 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
  5. 2018Learning Blind Video Temporal Consistencycited by 247
  6. 2018Deep Back-Projection Networks For Super-Resolutioncited by 224
  7. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  8. 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
  9. 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 164
  10. 2019FastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimationcited by 128
  11. 2019Adaptive Wing Loss for Robust Face Alignment via Heatmap Regressioncited by 127
  12. 2020Blind Face Restoration via Deep Multi-scale Component Dictionariescited by 106
  13. 2020Progressive Semantic-Aware Style Transformation for Blind Face Restorationcited by 99
  14. 2018Learning Warped Guidance for Blind Face Restorationcited by 87
  15. 2020Blind Video Temporal Consistency via Deep Video Priorcited by 76
  16. 2019Exemplar Guided Face Image Super-Resolution without Facial Landmarkscited by 57
  17. 2016Deep Cascaded Bi-Network for Face Hallucinationcited by 37
  18. 2021Deep Learning-based Face Super-Resolution: A Surveycited by 32
  19. 2019Learning to Have an Ear for Face Super-Resolutioncited by 11
  20. 2019Self-Enhanced Convolutional Network for Facial Video Hallucinationcited by 5
  21. 2020Video Face Super-Resolution with Motion-Adaptive Feedback Cellcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 7; 2024: 39; 2025: 79; 2026: 47.

174 papers.

Sort:

By area:

  1. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  2. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  3. 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
  4. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  5. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  6. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
  7. 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
  8. 2025Controllable Video Generation: A Surveycited by 93
  9. 2024V-Express: Conditional Dropout for Progressive Training of Portrait Video Generationcited by 85
  10. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  11. 2024Sonic: Shifting Focus to Global Audio Perception in Portrait Animationcited by 70
  12. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
38 more
  1. 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
  2. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  3. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  4. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
  5. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  6. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
  7. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  8. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  9. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
  10. 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
  11. 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
  12. 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 34
  13. 2025ARTalk: Speech-Driven 3D Head Animation via Autoregressive Modelcited by 28
  14. 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
  15. 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
  16. 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 27
  17. 2024MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Samplingcited by 27
  18. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
  19. 2025Human Motion Video Generation: A Surveycited by 25
  20. 2025InterActHuman: Multi-Concept Human Animation with Layout-Aligned Audio Conditionscited by 20
  21. 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
  22. 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 19
  23. 2024Omni-ID: Holistic Identity Representation Designed for Generative Taskscited by 18
  24. 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesiscited by 18
  25. 2025Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generationcited by 17
  26. 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
  27. 2025Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generationcited by 16
  28. 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
  29. 2024Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animationcited by 15
  30. 2024PersonaTalk: Bring Attention to Your Persona in Visual Dubbingcited by 15
  31. 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
  32. 2024DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactmentcited by 14
  33. 2025FixTalk: Taming Identity Leakage for High-Quality Talking Head Generation in Extreme Casescited by 14
  34. 2024MegActor-Sigma: Unlocking Flexible Mixed-Modal Control in Portrait Animation with Diffusion Transformercited by 13
  35. 2024MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devicescited by 12
  36. 2025SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusioncited by 12
  37. 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
  38. 2024Beyond Alignment: Blind Video Face Restoration via Parsing-Guided Temporal-Coherent Transformercited by 11

50 most cited of 174 All 174 (JSON)