mlsanityData to 7 Oct 2026

FNeVR: Neural Volume Rendering for Face Animation

arXiv 2209.10340 ↗First posted 21 Sep 2022cs.CVcited by 22

Not on the map. Why?

Abstract (arXiv)

Face animation, one of the hottest topics in computer vision, has achieved a promising performance with the help of generative models. However, it remains a critical challenge to generate identity preserving and photo-realistic images due to the sophisticated motion deformation and complex facial detail modeling. To address these problems, we propose a Face Neural Volume Rendering (FNeVR) network to fully explore the potential of 2D motion warping and 3D volume rendering in a unified framework. In FNeVR, we design a 3D Face Volume Rendering (FVR) module to enhance the facial details for image rendering. Specifically, we first extract 3D information with a well-designed architecture, and then introduce an orthogonal adaptive ray-sampling module for efficient rendering. We also design a lightweight pose editor, enabling FNeVR to edit the facial pose in a simple yet effective way. Extensive experiments show that our FNeVR obtains the best overall quality and performance on widely used talking-head benchmarks.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 21 Sep 2022.

Builds on

45 of 61 references.

References · 45

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  6. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  7. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  8. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  9. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  10. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  11. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  12. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
33 more
  1. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  2. 2020First Order Motion Model for Image Animationcited by 698
  3. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  4. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  5. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  6. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  7. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  8. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  9. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
  10. 2018Deep Video Portraitscited by 265
  11. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  12. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
  13. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  14. 2019Few-shot Video-to-Video Synthesiscited by 196
  15. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  16. 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
  17. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  18. 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 172
  19. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  20. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  21. 2017Morphable Face Models - An Open Frameworkcited by 138
  22. 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 116
  23. 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
  24. 2020HeadGAN: One-shot Neural Head Synthesis and Editingcited by 105
  25. 2019MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targetscited by 90
  26. 2020GIF: Generative Interpretable Facescited by 53
  27. 2017End-to-end 3D face reconstruction with deep neural networkscited by 47
  28. 2019Neural Style-Preserving Visual Dubbingcited by 47
  29. 2020Head2Head: Video-based Neural Head Synthesiscited by 40
  30. 2018DenseReg: Fully Convolutional Dense Shape Regression In-the-Wildcited by 32
  31. 2021SAFA: Structure Aware Face Animationcited by 20
  32. 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
  33. 20193D Dense Face Alignment via Graph Convolution Networkscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 8; 2025: 4; 2026: 2.

22 papers.

Sort:

By area:

  1. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  2. 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
  3. 2024AnimateAnything: Consistent and Controllable Animation for Video Generationcited by 34
  4. 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
  5. 2023Interactive Face Video Coding: A Generative Compression Frameworkcited by 17
  6. 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
  7. 2024Exposing Lip-syncing Deepfakes from Mouth Inconsistenciescited by 15
  8. 2023Learning Dense Correspondence for NeRF-Based Face Reenactmentcited by 12
  9. 2025LVFace: Progressive Cluster Optimization for Large Vision Models in Face Recognitioncited by 12
  10. 2024DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rayscited by 9
  11. 2024NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Priorcited by 8
  12. 2024Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Methodcited by 8
10 more
  1. 2023Learning Motion Refinement for Unsupervised Face Animationcited by 7
  2. 2025Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistenciescited by 7
  3. 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functionscited by 6
  4. 2024G3FA: Geometry-guided GAN for Face Animationcited by 2
  5. 2025High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approachcited by 2
  6. 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Priorcited by 1
  7. 2023Learning and Evaluating Human Preferences for Conversational Head Generationcited by 1
  8. 2024Learning Online Scale Transformation for Talking Head Video Generationcited by 1
  9. 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animationcited by 0
  10. 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Imagescited by 0