MotionScale: Reconstructing Appearance, Geometry, and Motion of Dynamic Scenes with Scalable 4D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Realistic reconstruction of dynamic 4D scenes from monocular videos is essential for understanding the physical world. Despite recent progress in neural rendering, existing methods often struggle to recover accurate 3D geometry and temporally consistent motion in complex environments. To address these challenges, we propose MotionScale, a 4D Gaussian Splatting framework that scales efficiently to large scenes and extended sequences while maintaining high-fidelity structural and motion coherence. At the core of our approach is a scalable motion field parameterized by cluster-centric basis transformations that adaptively expand to capture diverse and evolving motion patterns. To ensure robust reconstruction over long durations, we introduce a progressive optimization strategy comprising two decoupled propagation stages: 1) A background extension stage that adapts to newly visible regions, refines camera poses, and explicitly models transient shadows; 2) A foreground propagation stage that enforces motion consistency through a specialized three-stage refinement process. Extensive experiments on challenging real-world benchmarks demonstrate that MotionScale significantly outperforms state-of-the-art methods in both reconstruction quality and temporal stability. Project page: https://hrzhou2.github.io/motion-scale-web/.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 59 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
50 of 59 references.
References · 50
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
38 more
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 62
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
- 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
- 2025Motion Forecasting for Autonomous Vehicles: A Surveycited by 8
- 2021A Survey on Synchronous Augmented, Virtual and Mixed Reality Remote Collaboration Systemscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.