mlsanityData to 7 Oct 2026

Nerfies: Deformable Neural Radiance Fields

arXiv 2011.12948 ↗First posted 25 Nov 2020cs.CV cs.GRcited by 1,194

Not on the map. Why?

Cited by 49 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present the first method capable of photorealistically reconstructing deformable scenes using photos/videos captured casually from mobile phones. Our approach augments neural radiance fields (NeRF) by optimizing an additional continuous volumetric deformation field that warps each observed point into a canonical 5D NeRF. We observe that these NeRF-like deformation fields are prone to local minima, and propose a coarse-to-fine optimization method for coordinate-based models that allows for more robust optimization. By adapting principles from geometry processing and physical simulation to NeRF-like models, we propose an elastic regularization of the deformation field that further improves robustness. We show that our method can turn casually captured selfie photos/videos into deformable NeRF models that allow for photorealistic renderings of the subject from arbitrary viewpoints, which we dub "nerfies." We evaluate our method by collecting time-synchronized data using a rig with two mobile phones, yielding train/validation images of the same pose at different viewpoints. We show that our method faithfully reconstructs non-rigidly deforming scenes and reproduces unseen views with high fidelity.

Key facts. Cited by 1,194 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 44; 2022: 200; 2023: 317; 2024: 276; 2025: 203; 2026: 154.

1,194 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  3. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  4. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  5. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  6. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  7. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  8. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  9. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  10. 2021Neural Fields in Visual Computing and Beyondcited by 539
  11. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  12. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
38 more
  1. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  2. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  3. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
  4. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  5. 2021Advances in Neural Renderingcited by 365
  6. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  7. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  8. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  9. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  10. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
  11. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  12. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  13. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  14. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  15. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  16. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  17. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  18. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
  19. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  20. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  21. 2024A Survey on 3D Gaussian Splattingcited by 221
  22. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  23. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  24. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  25. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 216
  26. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  27. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
  28. 2023Text-To-4D Dynamic Scene Generationcited by 204
  29. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
  30. 2021Neural Articulated Radiance Fieldcited by 196
  31. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  32. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  33. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 195
  34. 2023Robust Dynamic Radiance Fieldscited by 193
  35. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  36. 2023Tracking Everything Everywhere All at Oncecited by 190
  37. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  38. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185

50 most cited of 1,194 All 1,194 (JSON)