mlsanityData to 14 Oct 2026

DynSUP: Dynamic Gaussian Splatting from An Unposed Image Pair

arXiv 2412.00851 ↗First posted 1 Dec 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advances in 3D Gaussian Splatting have shown promising results. Existing methods typically assume static scenes and/or multiple images with prior poses. Dynamics, sparse views, and unknown poses significantly increase the problem complexity due to insufficient geometric constraints. To overcome this challenge, we propose a method that can use only two images without prior poses to fit Gaussians in dynamic environments. To achieve this, we introduce two technical contributions. First, we propose an object-level two-view bundle adjustment. This strategy decomposes dynamic scenes into piece-wise rigid components, and jointly estimates the camera pose and motions of dynamic objects. Second, we design an SE(3) field-driven Gaussian training method. It enables fine-grained motion modeling through learnable per-Gaussian transformations. Our method leads to high-fidelity novel view synthesis of dynamic scenes while accurately preserving temporal consistency and object motion. Experiments on both synthetic and real-world datasets demonstrate that our method significantly outperforms state-of-the-art approaches designed for the cases of static environments, multiple images, and/or known poses. Our project page is available at https://colin-de.github.io/DynSUP/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 1 Dec 2024.

Builds on

44 of 61 references.

References · 44

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  6. 2024Depth Anything V2cited by 1,422
  7. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  10. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  11. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
  12. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
32 more
  1. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  2. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  3. 2022Kubric: A scalable dataset generatorcited by 381
  4. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  5. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  6. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  7. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  8. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  9. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
  10. 2022Unifying Flow, Stereo and Depth Estimationcited by 275
  11. 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
  12. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
  13. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  14. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  15. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
  16. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
  17. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
  18. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  19. 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
  20. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
  21. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
  22. 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 70
  23. 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
  24. 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
  25. 2021Learning to Segment Rigid Motions from Two Framescited by 46
  26. 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 39
  27. 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
  28. 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
  29. 2022PyPose: A Library for Robot Learning with Physics-based Optimizationcited by 29
  30. 2024GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-timecited by 20
  31. 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 18
  32. 2024PLGS: Robust Panoptic Lifting with 3D Gaussian Splattingcited by 17

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.