DynSUP: Dynamic Gaussian Splatting from An Unposed Image Pair
Not on the map. Why?
Abstract (arXiv)
Recent advances in 3D Gaussian Splatting have shown promising results. Existing methods typically assume static scenes and/or multiple images with prior poses. Dynamics, sparse views, and unknown poses significantly increase the problem complexity due to insufficient geometric constraints. To overcome this challenge, we propose a method that can use only two images without prior poses to fit Gaussians in dynamic environments. To achieve this, we introduce two technical contributions. First, we propose an object-level two-view bundle adjustment. This strategy decomposes dynamic scenes into piece-wise rigid components, and jointly estimates the camera pose and motions of dynamic objects. Second, we design an SE(3) field-driven Gaussian training method. It enables fine-grained motion modeling through learnable per-Gaussian transformations. Our method leads to high-fidelity novel view synthesis of dynamic scenes while accurately preserving temporal consistency and object motion. Experiments on both synthetic and real-world datasets demonstrate that our method significantly outperforms state-of-the-art approaches designed for the cases of static environments, multiple images, and/or known poses. Our project page is available at https://colin-de.github.io/DynSUP/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 1 Dec 2024.
Builds on
44 of 61 references.
References · 44
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2024Depth Anything V2cited by 1,422
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
32 more
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2022Kubric: A scalable dataset generatorcited by 381
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 70
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
- 2021Learning to Segment Rigid Motions from Two Framescited by 46
- 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 39
- 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2022PyPose: A Library for Robot Learning with Physics-based Optimizationcited by 29
- 2024GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-timecited by 20
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 18
- 2024PLGS: Robust Panoptic Lifting with 3D Gaussian Splattingcited by 17
Built on by
Citing papers per year: 2025: 1.
1 paper.