DispFlow-GS: Displacement Flow Supervision with Motion Disentangling for Monocular Deformable 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Accurate dynamic scene reconstruction is important for robotic perception, where temporally consistent representations of dynamic environments are essential. Deformable 3D Gaussian Splatting (3DGS) models dynamic scenes through deformation fields, and recent methods incorporate motion supervision by aligning rendered Gaussian flow with optical flow. However, we find that such Gaussian-flow-based supervision provides only limited improvements in motion modeling. We identify a fundamental limitation of this supervision paradigm, namely a domain gap between rendered Gaussian flow and optical flow. To address this limitation, we propose a motion supervision framework built on Displacement Flow, which splats per-Gaussian 3D displacements onto the image plane to provide direct and stable optimization signals. We further disentangle scene motion from camera motion via intermediate-view rendering, enabling more reliable motion priors and targeted constraints on deformation and geometry. We also observe a discrepancy between motion fidelity and image-based evaluation, where improved motion awareness does not necessarily translate into better rendered image quality or higher image-based metric scores. Motivated by this mismatch, we introduce Deformation-Rendering Consistency (DRC), a motion-aware metric that measures the alignment between predicted deformation and rendering improvement. Experiments on dynamic scene benchmarks show substantial improvements in motion localization and motion--rendering consistency, reaching up to 39% and 6%, respectively, while image-based metrics change by only about 0.1%. These results confirm the observed mismatch between motion fidelity and image-based evaluation, demonstrating the significance of DRC for motion-aware evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 40 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
36 of 40 references.
References · 36
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
24 more
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
- 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 111
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 63
- 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
- 2024Flow4D: Leveraging 4D Voxel Network for LiDAR Scene Flow Estimationcited by 23
- 2024SplatFlow: Self-Supervised Dynamic Gaussian Splatting in Neural Motion Flow Field for Autonomous Drivingcited by 20
- 2024RoMo: Robust Motion Segmentation Improves Structure from Motioncited by 20
- 2024DualAD: Disentangling the Dynamic and Static World for End-to-End Drivingcited by 17
- 20244D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitivescited by 15
- 2025SSF: Sparse Long-Range Scene Flow for Autonomous Drivingcited by 13
- 2022MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillationcited by 10
- 2024Gaussian Splatting Lucas-Kanadecited by 2
- 2024DynORecon: Dynamic Object Reconstruction for Navigationcited by 2
- 2025Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAMcited by 2
Built on by
Not cited yet.