MOSAIC-GS: Monocular Scene Reconstruction via Advanced Initialization for Complex Dynamic Environments
Not on the map. Why?
Abstract (arXiv)
We present MOSAIC-GS, a novel, fully explicit, and computationally efficient approach for high-fidelity dynamic scene reconstruction from monocular videos using Gaussian Splatting. Monocular reconstruction is inherently ill-posed due to the lack of sufficient multiview constraints, making accurate recovery of object geometry and temporal coherence particularly challenging. To address this, we leverage multiple geometric cues, such as depth, optical flow, dynamic object segmentation, and point tracking. Combined with rigidity-based motion constraints, these cues allow us to estimate preliminary 3D scene dynamics during an initialization stage. Recovering scene dynamics prior to the photometric optimization reduces reliance on motion inference from visual appearance alone, which is often ambiguous in monocular settings. To enable compact representations, fast training, and real-time rendering while supporting non-rigid deformations, the scene is decomposed into static and dynamic components. Each Gaussian in the dynamic part of the scene is assigned a trajectory represented as time-dependent Poly-Fourier curve for parameter-efficient motion encoding. We demonstrate that MOSAIC-GS achieves substantially faster optimization and rendering compared to existing methods, while maintaining reconstruction quality on par with state-of-the-art approaches across standard monocular dynamic scene benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
45 of 55 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017Mask R-CNNcited by 7,259
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
33 more
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2022MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videoscited by 63
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
- 2020FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flowcited by 36
- 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Imagescited by 35
- 2025Segment Any Motion in Videoscited by 34
- 2023Fast View Synthesis of Casual Videos with Soup-of-Planescited by 22
- 2024CTNeRF: Cross-Time Transformer for Dynamic Neural Radiance Field from Monocular Videocited by 18
Built on by
Not cited yet.