Prior-Enhanced Gaussian Splatting for Dynamic Scene Reconstruction from Casual Video
Not on the map. Why?
Abstract (arXiv)
We introduce a fully automatic pipeline for dynamic scene reconstruction from casually captured monocular RGB videos. Rather than designing a new scene representation, we enhance the priors that drive Dynamic Gaussian Splatting. Video segmentation combined with epipolar-error maps yields object-level masks that closely follow thin structures; these masks (i) guide an object-depth loss that sharpens the consistent video depth, and (ii) support skeleton-based sampling plus mask-guided re-identification to produce reliable, comprehensive 2-D tracks. Two additional objectives embed the refined priors in the reconstruction stage: a virtual-view depth loss removes floaters, and a scaffold-projection loss ties motion nodes to the tracks, preserving fine geometry and coherent motion. The resulting system surpasses previous monocular dynamic scene reconstruction methods and delivers visibly superior renderings
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 56 of its 86 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
56 of 86 references.
References · 56
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
38 more
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2023Track Anything: Segment Anything Meets Videoscited by 230
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2020Robust Consistent Video Depth Estimationcited by 188
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 88
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
- 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 67
- 20204D Visualization of Dynamic Events from Unconstrained Multi-View Videoscited by 66
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
- 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
- 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
- 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenescited by 37
- 2023Pseudo-Generalized Dynamic View Synthesis from a Videocited by 27
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 8
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
- 20263AM: 3egment Anything with Geometric Consistency in Videoscited by 3
- 2026LiDAR-EVS: Enhance Extrapolated View Synthesis for 3D Gaussian Splatting with Pseudo-LiDAR Supervisioncited by 1
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026LiDAR-EVS: Enhance Extrapolated View Synthesis for 3D Gaussian Splatting with Pseudo-LiDAR Supervision16 Mar 2026
- 20263AM: 3egment Anything with Geometric Consistency in Videos13 Jan 2026
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstruction2 Jan 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025