mlsanityData to 7 Oct 2026

DynIBaR: Neural Dynamic Image-Based Rendering

arXiv 2211.11082 ↗First posted 20 Nov 2022cs.CVcited by 224

Not on the map. Why?

Abstract (arXiv)

We address the problem of synthesizing novel views from a monocular video depicting a complex dynamic scene. State-of-the-art methods based on temporally varying Neural Radiance Fields (aka dynamic NeRFs) have shown impressive results on this task. However, for long videos with complex object motions and uncontrolled camera trajectories, these methods can produce blurry or inaccurate renderings, hampering their use in real-world applications. Instead of encoding the entire dynamic scene within the weights of MLPs, we present a new approach that addresses these limitations by adopting a volumetric image-based rendering framework that synthesizes new viewpoints by aggregating features from nearby views in a scene-motion-aware manner. Our system retains the advantages of prior methods in its ability to model complex scenes and view-dependent effects, but also enables synthesizing photo-realistic novel views from long videos featuring complex scene dynamics with unconstrained camera trajectories. We demonstrate significant improvements over state-of-the-art methods on dynamic scene datasets, and also apply our approach to in-the-wild videos with challenging camera and object motion, where prior methods fail to produce high-quality renderings. Our project webpage is at dynibar.github.io.

Key facts. Cited by 224 papers in the map (data through 7 Oct 2026). Builds on 62 of its 97 references that are in the map. First posted on arXiv 20 Nov 2022.

Builds on

62 of 97 references.

References · 62

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  9. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  10. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  12. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
38 more
  1. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  2. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  3. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  4. 2020Neural Sparse Voxel Fieldscited by 959
  5. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  8. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  9. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  10. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  11. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  12. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  13. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  14. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  15. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  16. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  17. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  18. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  19. 2020Free View Synthesiscited by 231
  20. 2020Consistent Video Depth Estimationcited by 220
  21. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  22. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
  23. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
  24. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
  25. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  26. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  27. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  28. 2020Robust Consistent Video Depth Estimationcited by 188
  29. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  30. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  31. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  32. 2020Stable View Synthesiscited by 165
  33. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  34. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  35. 2021Editable Free-viewpoint Video Using a Layered Neural Representationcited by 148
  36. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  37. 2021Layered Neural Atlases for Consistent Video Editingcited by 137
  38. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 43; 2024: 81; 2025: 73; 2026: 26.

224 papers.

Sort:

By area:

  1. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  2. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  3. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  4. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  5. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 216
  6. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  7. 2023Tracking Everything Everywhere All at Oncecited by 190
  8. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  9. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  10. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  11. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  12. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
38 more
  1. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  2. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  3. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  4. 2023Generative Image Dynamicscited by 93
  5. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
  6. 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
  7. 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
  8. 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
  9. 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 88
  10. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
  11. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  12. 2023Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clipscited by 73
  13. 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 69
  14. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
  15. 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
  16. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
  17. 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 60
  18. 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 53
  19. 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
  20. 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
  21. 2023EPIC Fields: Marrying 3D Geometry and Video Understandingcited by 49
  22. 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
  23. 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 48
  24. 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
  25. 2024GFlow: Recovering 4D World from Monocular Videocited by 46
  26. 2024Efficient4D: Fast Dynamic 3D Object Generation from a Single-view Videocited by 44
  27. 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
  28. 2025Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstructioncited by 43
  29. 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
  30. 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
  31. 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 36
  32. 2024Dynamic 3D Gaussian Fields for Urban Areascited by 35
  33. 2023HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Videocited by 33
  34. 2024Relaxing Accurate Initialization Constraint for 3D Gaussian Splattingcited by 33
  35. 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
  36. 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 31
  37. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  38. 2024DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Renderingcited by 28

50 most cited of 224 All 224 (JSON)