Robust Dynamic Radiance Fields
Not on the map. Why?
Abstract (arXiv)
Dynamic radiance field reconstruction methods aim to model the time-varying structure and appearance of a dynamic scene. Existing methods, however, assume that accurate camera poses can be reliably estimated by Structure from Motion (SfM) algorithms. These methods, thus, are unreliable as SfM algorithms often fail or produce erroneous poses on challenging videos with highly dynamic objects, poorly textured surfaces, and rotating camera motion. We address this robustness issue by jointly estimating the static and dynamic radiance fields along with the camera parameters (poses and focal length). We demonstrate the robustness of our approach via extensive quantitative and qualitative experiments. Our results show favorable performance over the state-of-the-art dynamic view synthesis methods.
Key facts. Cited by 193 papers in the map (data through 7 Oct 2026). Builds on 56 of its 86 references that are in the map. First posted on arXiv 5 Jan 2023.
Builds on
56 of 86 references.
References · 56
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2017Mask R-CNNcited by 7,259
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
38 more
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2016Direct Sparse Odometrycited by 479
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2020Free View Synthesiscited by 231
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 2020Robust Consistent Video Depth Estimationcited by 188
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 2020Stable View Synthesiscited by 165
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 130
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2019Learning the Depths of Moving People by Watching Frozen Peoplecited by 120
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 101
- 2018Extreme View Synthesiscited by 94
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 90
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
- 20204D Visualization of Dynamic Events from Unconstrained Multi-View Videoscited by 66
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2023: 35; 2024: 71; 2025: 57; 2026: 30.
193 papers.
Sort:
By area:
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2023Progressively Optimized Local Radiance Fields for Robust View Synthesiscited by 103
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
38 more
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 53
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
- 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
- 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 48
- 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
- 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
- 2023Masked Space-Time Hash Encoding for Efficient Dynamic Scene Reconstructioncited by 43
- 2024Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene Reconstructioncited by 43
- 2024BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modelingcited by 42
- 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 38
- 2024Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfelscited by 38
- 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 36
- 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
- 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 31
- 2025MoDec-GS: Global-to-Local Motion Decomposition and Temporal Interval Adjustment for Compact Dynamic 3D Gaussian Splattingcited by 30
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2023Pseudo-Generalized Dynamic View Synthesis from a Videocited by 27
- 2025Dynamic Camera Poses and Where to Find Themcited by 26
- 2024NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided Segmentationcited by 25
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videoscited by 23
- 2023Fast View Synthesis of Casual Videos with Soup-of-Planescited by 22
- 2023Dynamic LiDAR Re-simulation using Compositional Neural Fieldscited by 22
- 2024EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splattingcited by 22
- 2024Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fieldscited by 22
- 2023Dynamic Mesh-Aware Radiance Fieldscited by 21
- 2024VividDream: Generating 3D Scene with Ambient Dynamicscited by 21
- 2024SpectroMotion: Dynamic 3D Reconstruction of Specular Scenescited by 21
- 2025AuraFusion360: Augmented Unseen Region Alignment for Reference-based 360deg Unbounded Scene Inpaintingcited by 21
- 2025Generative Video Motion Editing with 3D Point Trackscited by 21
- 2023Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesiscited by 20
- 2024RoMo: Robust Motion Segmentation Improves Structure from Motioncited by 20
- 2023NViST: In the Wild New View Synthesis from a Single Image with Transformerscited by 19
50 most cited of 193 All 193 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction5 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026GrainGS: Gradient-Decoupled Gaussian Splatting for Efficient Dynamic Novel View Synthesis23 Jul 2026
- 2026TOM-GS: Editable Video Representation via Temporal Opacity Modulation of Static 3D Gaussians21 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 2026Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video27 Jun 2026
- 2026Recent Advances and Trends in Learning-based 3D Representations3 Jun 2026
- 2026WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos1 Jun 2026
38 more
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video22 May 2026
- 2026DySurface: Consistent 4D Surface Reconstruction via Bridging Explicit Gaussians and Implicit Functions11 May 2026
- 2026PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction11 May 2026
- 2026SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis8 May 2026
- 2026Velox: Learning Representations of 4D Geometry and Appearance6 May 2026
- 2026MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene20 Apr 2026
- 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction6 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 20264DGS360: 360deg Gaussian Reconstruction of Dynamic Objects from a Single Video23 Mar 2026
- 20264D Synchronized Fields: Motion-Language Gaussian Splatting for Temporal Scene Understanding15 Mar 2026
- 20263DGS-HPC: Distractor-free 3D Gaussian Splatting with Hybrid Patch-wise Classification8 Mar 2026
- 2026Lie Flow: Video Dynamic Fields Modeling and Predicting with Lie Algebra as Geometric Physics Principle25 Feb 2026
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction24 Feb 2026
- 2026WorldTree: Towards 4D Dynamic Worlds from Monocular Video using Tree-Chains12 Feb 2026
- 20263AM: 3egment Anything with Geometric Consistency in Videos13 Jan 2026
- 2026GS-DMSR: Dynamic Sensitive Multi-scale Manifold Enhancement for Accelerated High-Quality 3D Gaussian Splatting9 Jan 2026
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstruction2 Jan 2026
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priors25 Dec 2025
- 2025Generative Refocusing: Flexible Defocus Control from a Single Image18 Dec 2025
- 2025Broadening View Synthesis of Dynamic Scenes from Constrained Monocular Videos16 Dec 2025
- 2025From Particles to Fields: Reframing Photon Mapping with Continuous Gaussian Photon Fields13 Dec 2025
- 2025TraceFlow: Dynamic 3D Reconstruction of Specular Scenes Driven by Ray Tracing10 Dec 2025
- 2025Voxify3D: Pixel Art Meets Volumetric Rendering8 Dec 2025
- 2025Splannequin: Freezing Monocular Mannequin-Challenge Footage with Dual-Detection Splatting4 Dec 2025
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling2 Dec 2025
- 2025Generative Video Motion Editing with 3D Point Tracks1 Dec 2025
- 2025Dynamic Avatar-Scene Rendering from Human-centric Context13 Nov 2025
- 20254D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videos7 Nov 2025
- 2025Mono4DGS-HDR: High Dynamic Range 4D Gaussian Splatting from Alternating-exposure Monocular Videos21 Oct 2025
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
- 2025Vectorized Video Representation with Easy Editing via Hierarchical Spatio-Temporally Consistent Proxy Embedding14 Oct 2025
- 2025Color3D: Controllable and Consistent 3D Colorization with Personalized Colorizer11 Oct 2025
- 2025DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Stream9 Oct 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Instant4D: 4D Gaussian Splatting in Minutes1 Oct 2025
- 2025Orientation-anchored Hyper-Gaussian for 4D Reconstruction from Casual Videos27 Sep 2025
- 2025Neural Atlas Graphs for Dynamic Scene Decomposition and Editing19 Sep 2025
50 newest of 193 All 193 (JSON)
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 36
- 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videoscited by 18
- 2024BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priorscited by 14
- 2025Dynamic View Synthesis as an Inverse Problemcited by 12
- 2024NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editingcited by 7
- 2025Restereo: Diffusion stereo video generation and restorationcited by 5
- 2025ViDAR: Video Diffusion-Aware 4D Reconstruction From Monocular Inputscited by 4
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
- 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splattingcited by 2
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2025ViDAR: Video Diffusion-Aware 4D Reconstruction From Monocular Inputs23 Jun 2025
- 2025Dynamic View Synthesis as an Inverse Problem9 Jun 2025
- 2025Restereo: Diffusion stereo video generation and restoration6 Jun 2025
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar 2025
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec 2024
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videos11 Sep 2024
- 2024NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing10 Jun 2024
- 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting4 Jun 2024
- 2024BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priors18 Mar 2024
- 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videos10 Jan 2024
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2023Progressively Optimized Local Radiance Fields for Robust View Synthesiscited by 103
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
- 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
12 most cited of 179 All 179 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction5 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026GrainGS: Gradient-Decoupled Gaussian Splatting for Efficient Dynamic Novel View Synthesis23 Jul 2026
- 2026TOM-GS: Editable Video Representation via Temporal Opacity Modulation of Static 3D Gaussians21 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 2026Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video27 Jun 2026
- 2026Recent Advances and Trends in Learning-based 3D Representations3 Jun 2026
- 2026WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos1 Jun 2026
12 newest of 179 All 179 (JSON)