mlsanityData to 14 Oct 2026

Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video

arXiv 2012.12247 ↗First posted 22 Dec 2020cs.CV cs.GRcited by 471

Not on the map. Why?

Abstract (arXiv)

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video recording), and creates a high-quality space-time geometry and appearance representation. We show that a single handheld consumer-grade camera is sufficient to synthesize sophisticated renderings of a dynamic scene from novel virtual camera views, e.g. a `bullet-time' video effect. NR-NeRF disentangles the dynamic scene into a canonical volume and its deformation. Scene deformation is implemented as ray bending, where straight rays are deformed non-rigidly. We also propose a novel rigidity network to better constrain rigid regions of the scene, leading to more stable results. The ray bending and rigidity network are trained without explicit supervision. Our formulation enables dense correspondence estimation across views and time, and compelling video editing applications such as motion exaggeration. Our code will be open sourced.

Key facts. Cited by 471 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 32; 2022: 87; 2023: 140; 2024: 113; 2025: 60; 2026: 39.

471 papers.

Sort:

By area:

  1. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  4. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  5. 2021Neural Fields in Visual Computing and Beyondcited by 540
  6. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  7. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
  8. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  9. 2021Advances in Neural Renderingcited by 365
  10. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  11. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  12. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
38 more
  1. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  2. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
  3. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 229
  4. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  5. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  6. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  7. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
  8. 2023Text-To-4D Dynamic Scene Generationcited by 205
  9. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  10. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
  11. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
  12. 2023Robust Dynamic Radiance Fieldscited by 194
  13. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  14. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
  15. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  16. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  17. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  18. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 165
  19. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  20. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
  21. 2022Instant Volumetric Head Avatarscited by 159
  22. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
  23. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
  24. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  25. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  26. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  27. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 127
  28. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  29. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
  30. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  31. 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
  32. 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
  33. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
  34. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
  35. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  36. 2021NeRF for Outdoor Scene Relightingcited by 114
  37. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  38. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112

50 most cited of 471 All 471 (JSON)