mlsanityData to 7 Oct 2026

MotionScale: Reconstructing Appearance, Geometry, and Motion of Dynamic Scenes with Scalable 4D Gaussian Splatting

arXiv 2603.29296 ↗First posted 31 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Realistic reconstruction of dynamic 4D scenes from monocular videos is essential for understanding the physical world. Despite recent progress in neural rendering, existing methods often struggle to recover accurate 3D geometry and temporally consistent motion in complex environments. To address these challenges, we propose MotionScale, a 4D Gaussian Splatting framework that scales efficiently to large scenes and extended sequences while maintaining high-fidelity structural and motion coherence. At the core of our approach is a scalable motion field parameterized by cluster-centric basis transformations that adaptively expand to capture diverse and evolving motion patterns. To ensure robust reconstruction over long durations, we introduce a progressive optimization strategy comprising two decoupled propagation stages: 1) A background extension stage that adapts to newly visible regions, refines camera poses, and explicitly models transient shadows; 2) A foreground propagation stage that enforces motion consistency through a specialized three-stage refinement process. Extensive experiments on challenging real-world benchmarks demonstrate that MotionScale significantly outperforms state-of-the-art methods in both reconstruction quality and temporal stability. Project page: https://hrzhou2.github.io/motion-scale-web/.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 59 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

50 of 59 references.

References · 50

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023Segment Anythingcited by 8,158
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  10. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  11. 2024Depth Anything V2cited by 1,385
  12. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
38 more
  1. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  2. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  3. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  4. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  5. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  6. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  7. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  9. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  10. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  11. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  12. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  13. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
  14. 2023CoTracker: It is Better to Track Togethercited by 516
  15. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  16. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  17. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  18. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  19. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  20. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
  21. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
  22. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  23. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
  24. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  25. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  26. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
  27. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
  28. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  29. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
  30. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  31. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  32. 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
  33. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
  34. 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 62
  35. 2024GFlow: Recovering 4D World from Monocular Videocited by 46
  36. 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
  37. 2025Motion Forecasting for Autonomous Vehicles: A Surveycited by 8
  38. 2021A Survey on Synchronous Augmented, Virtual and Mixed Reality Remote Collaboration Systemscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.