mlsanityData to 14 Oct 2026

DispFlow-GS: Displacement Flow Supervision with Motion Disentangling for Monocular Deformable 3D Gaussian Splatting

arXiv 2609.36940 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate dynamic scene reconstruction is important for robotic perception, where temporally consistent representations of dynamic environments are essential. Deformable 3D Gaussian Splatting (3DGS) models dynamic scenes through deformation fields, and recent methods incorporate motion supervision by aligning rendered Gaussian flow with optical flow. However, we find that such Gaussian-flow-based supervision provides only limited improvements in motion modeling. We identify a fundamental limitation of this supervision paradigm, namely a domain gap between rendered Gaussian flow and optical flow. To address this limitation, we propose a motion supervision framework built on Displacement Flow, which splats per-Gaussian 3D displacements onto the image plane to provide direct and stable optimization signals. We further disentangle scene motion from camera motion via intermediate-view rendering, enabling more reliable motion priors and targeted constraints on deformation and geometry. We also observe a discrepancy between motion fidelity and image-based evaluation, where improved motion awareness does not necessarily translate into better rendered image quality or higher image-based metric scores. Motivated by this mismatch, we introduce Deformation-Rendering Consistency (DRC), a motion-aware metric that measures the alignment between predicted deformation and rendering improvement. Experiments on dynamic scene benchmarks show substantial improvements in motion localization and motion--rendering consistency, reaching up to 39% and 6%, respectively, while image-based metrics change by only about 0.1%. These results confirm the observed mismatch between motion fidelity and image-based evaluation, demonstrating the significance of DRC for motion-aware evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 40 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

36 of 40 references.

References · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  5. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  9. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  10. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  11. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  12. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
24 more
  1. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  2. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  3. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  4. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  5. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  6. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  7. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
  8. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  9. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
  10. 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 111
  11. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  12. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
  13. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 63
  14. 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
  15. 2024Flow4D: Leveraging 4D Voxel Network for LiDAR Scene Flow Estimationcited by 23
  16. 2024SplatFlow: Self-Supervised Dynamic Gaussian Splatting in Neural Motion Flow Field for Autonomous Drivingcited by 20
  17. 2024RoMo: Robust Motion Segmentation Improves Structure from Motioncited by 20
  18. 2024DualAD: Disentangling the Dynamic and Static World for End-to-End Drivingcited by 17
  19. 20244D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitivescited by 15
  20. 2025SSF: Sparse Long-Range Scene Flow for Autonomous Drivingcited by 13
  21. 2022MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillationcited by 10
  22. 2024Gaussian Splatting Lucas-Kanadecited by 2
  23. 2024DynORecon: Dynamic Object Reconstruction for Navigationcited by 2
  24. 2025Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAMcited by 2

Built on by

Not cited yet.