mlsanityData to 7 Oct 2026

Portrait Neural Radiance Fields from a Single Image

arXiv 2012.05903 ↗First posted 10 Dec 2020cs.CVcited by 61

Not on the map. Why?

Abstract (arXiv)

We present a method for estimating Neural Radiance Fields (NeRF) from a single headshot portrait. While NeRF has demonstrated high-quality view synthesis, it requires multiple images of static scenes and thus impractical for casual captures and moving subjects. In this work, we propose to pretrain the weights of a multilayer perceptron (MLP), which implicitly models the volumetric density and colors, with a meta-learning framework using a light stage portrait dataset. To improve the generalization to unseen faces, we train the MLP in the canonical coordinate space approximated by 3D face morphable models. We quantitatively evaluate the method using controlled captures and demonstrate the generalization to real portrait images, showing favorable results against state-of-the-arts.

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 20; 2022: 19; 2023: 14; 2024: 6; 2025: 2.

61 papers.

Sort:

By area:

  1. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  2. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  3. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  4. 2021Neural Fields in Visual Computing and Beyondcited by 539
  5. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  6. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  7. 2021Advances in Neural Renderingcited by 365
  8. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  9. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  10. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  11. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  12. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
38 more
  1. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  2. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  3. 2022Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesiscited by 97
  4. 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
  5. 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
  6. 2021Neural Trajectory Fields for Dynamic Novel View Synthesiscited by 85
  7. 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
  8. 2021Learning to Stylize Novel Viewscited by 76
  9. 2022Unified Implicit Neural Stylizationcited by 67
  10. 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
  11. 2022Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentationscited by 46
  12. 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
  13. 2023ViP-NeRF: Visibility Prior for Sparse Input Neural Radiance Fieldscited by 43
  14. 2023MixNeRF: Modeling a Ray with Mixture Density for Novel View Synthesis from Sparse Inputscited by 40
  15. 2022FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression Editingcited by 38
  16. 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
  17. 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
  18. 2022RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesiscited by 33
  19. 2022S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpointcited by 30
  20. 2022Neural Novel Actor: Learning a Generalized Animatable Neural Representation for Human Actorscited by 28
  21. 2022High-fidelity Facial Avatar Reconstruction from Monocular Video with Generative Priorscited by 28
  22. 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Spacecited by 22
  23. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
  24. 2023Generalizable One-shot Neural Head Avatarcited by 21
  25. 2023Neural Image-based Avatars: Generalizable Radiance Fields for Human Avatar Modelingcited by 19
  26. 2024FrugalNeRF: Fast Convergence for Extreme Few-shot Novel View Synthesis without Learned Priorscited by 18
  27. 20223D-Aware Video Generationcited by 17
  28. 2024GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understandingcited by 15
  29. 2023SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Imagescited by 11
  30. 20223DMM-RF: Convolutional Radiance Fields for 3D Face Modelingcited by 10
  31. 2024Real-time 3D-aware Portrait Editing from a Single Imagecited by 10
  32. 2022Collaborative Neural Rendering using Anime Character Sheetscited by 8
  33. 2023Neural Radiance Fields: Past, Present, and Futurecited by 8
  34. 2021DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editingcited by 7
  35. 2022SmartPortraits: Depth Powered Handheld Smartphone Dataset of Human Portraits for State Estimation, Reconstruction and Synthesiscited by 7
  36. 2021FreeStyleGAN: Free-view Editable Portrait Rendering with the Camera Manifoldcited by 6
  37. 2022Multi-NeuS: 3D Head Portraits from Single Image with Neural Implicit Functionscited by 6
  38. 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANscited by 6

50 most cited of 61 All 61 (JSON)