4DGS360: 360deg Gaussian Reconstruction of Dynamic Objects from a Single Video
Not on the map. Why?
Abstract (arXiv)
We introduce 4DGS360, a diffusion-free framework for 360circ dynamic object reconstruction from casual monocular video. Existing methods often fail to reconstruct consistent 360circ geometry, as their heavy reliance on 2D-native priors causes initial points to overfit to visible surface in each training view. 4DGS360 addresses this challenge through a advanced 3D-native initialization that mitigates the geometric ambiguity of occluded regions. Our proposed 3D tracker, AnchorTAP3D, produces reinforced 3D point trajectories by leveraging confident 2D track points as anchors, suppressing drift and providing reliable initialization that preserves geometry in occluded regions. This initialization, combined with optimization, yields coherent 360circ 4D reconstructions. We further present iPhone360, a new benchmark where test cameras are placed up to 135circ apart from training views, enabling 360circ evaluation that existing datasets cannot provide. Experiments show that 4DGS360 achieves state-of-the-art performance on the iPhone360, iPhone, and DAVIS datasets, both qualitatively and quantitatively.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 56 of its 65 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
56 of 65 references.
References · 56
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2024Depth Anything V2cited by 1,385
38 more
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2023Track Anything: Segment Anything Meets Videoscited by 230
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2024Taming 3DGS: High-Quality Radiance Fields with Limited Resourcescited by 198
- 2023Robust Dynamic Radiance Fieldscited by 193
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2024MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereocited by 86
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
- 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 67
- 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
- 2023SMERF: Streamable Memory Efficient Radiance Fields for Real-Time Large-Scene Explorationcited by 62
- 2024CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussianscited by 62
- 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.