mlsanityData to 7 Oct 2026

Face2Face: Real-time Face Capture and Reenactment of RGB Videos

arXiv 2007.14808 ↗First posted 29 Jul 2020cs.CVcited by 631

Not on the map. Why?

Cited by 28 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present Face2Face, a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.

Key facts. Cited by 631 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 124; 2022: 138; 2023: 126; 2024: 100; 2025: 80; 2026: 63.

631 papers.

Sort:

By area:

  1. 2021Advances in Neural Renderingcited by 365
  2. 2021Multi-attentional Deepfake Detectioncited by 339
  3. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  4. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  5. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  6. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  7. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  8. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  9. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  10. 2021Motion Representations for Articulated Animationcited by 253
  11. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
  12. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
38 more
  1. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  2. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
  3. 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
  4. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
  5. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  6. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
  7. 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 172
  8. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  9. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  10. 2022Towards Metrical Reconstruction of Human Facescited by 165
  11. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
  12. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
  13. 2022Instant Volumetric Head Avatarscited by 157
  14. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  15. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
  16. 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
  17. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  18. 2023DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animationcited by 136
  19. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
  20. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  21. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  22. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  23. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
  24. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
  25. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  26. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 122
  27. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  28. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  29. 2021Representative Forgery Mining for Fake Face Detectioncited by 108
  30. 2021One Shot Face Swapping on Megapixelscited by 105
  31. 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
  32. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
  33. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  34. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  35. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
  36. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  37. 2022Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesiscited by 97
  38. 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95

50 most cited of 631 All 631 (JSON)