mlsanityData to 7 Oct 2026

Dynamic View Synthesis from Dynamic Monocular Video

arXiv 2105.06468 ↗First posted 13 May 2021cs.CVcited by 420

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present an algorithm for generating novel views at arbitrary viewpoints and any input time step given a monocular video of a dynamic scene. Our work builds upon recent advances in neural implicit representation and uses continuous and differentiable functions for modeling the time-varying structure and the appearance of the scene. We jointly train a time-invariant static NeRF and a time-varying dynamic NeRF, and learn how to blend the results in an unsupervised manner. However, learning this implicit function from a single video is highly ill-posed (with infinitely many solutions that match the input video). To resolve the ambiguity, we introduce regularization losses to encourage a more physically plausible solution. We show extensive quantitative and qualitative results of dynamic view synthesis from casually captured videos.

Key facts. Cited by 420 papers in the map (data through 7 Oct 2026). Builds on 36 of its 62 references that are in the map. First posted on arXiv 13 May 2021.

Builds on

36 of 62 references.

References · 36

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  7. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  8. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  9. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  10. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  11. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  12. 2020Convolutional Occupancy Networkscited by 760
24 more
  1. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  2. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  3. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  4. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  5. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  6. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  7. 2020State of the Art on Neural Renderingcited by 276
  8. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  9. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  10. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  11. 2020Free View Synthesiscited by 231
  12. 2020Consistent Video Depth Estimationcited by 220
  13. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  14. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  15. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  16. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  17. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  18. 20193D Ken Burns Effect from a Single Imagecited by 128
  19. 2020Differentiable Rendering: A Surveycited by 123
  20. 20204D Visualization of Dynamic Events from Unconstrained Multi-View Videoscited by 66
  21. 2020MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Imagescited by 64
  22. 2020Portrait Neural Radiance Fields from a Single Imagecited by 61
  23. 2020One Shot 3D Photographycited by 45
  24. 2020Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearancecited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 13; 2022: 55; 2023: 118; 2024: 125; 2025: 70; 2026: 39.

420 papers.

Sort:

By area:

  1. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  2. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  4. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  5. 2021Neural Fields in Visual Computing and Beyondcited by 539
  6. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  7. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
  8. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  9. 2021Advances in Neural Renderingcited by 365
  10. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
  11. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  12. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
38 more
  1. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  2. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  3. 2021Urban Radiance Fieldscited by 263
  4. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  5. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  6. 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
  7. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  8. 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
  9. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  10. 2023Text-To-4D Dynamic Scene Generationcited by 204
  11. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
  12. 2023Robust Dynamic Radiance Fieldscited by 193
  13. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  14. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  15. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
  16. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  17. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  18. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  19. 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
  20. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  21. 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 150
  22. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  23. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
  24. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  25. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  26. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  27. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  28. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  29. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  30. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  31. 2022DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenescited by 103
  32. 2023Progressively Optimized Local Radiance Fields for Robust View Synthesiscited by 103
  33. 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 103
  34. 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
  35. 2022Generative Neural Articulated Radiance Fieldscited by 101
  36. 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
  37. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  38. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96

50 most cited of 420 All 420 (JSON)