When 3D Gaussian Splatting Recovers Real Surfaces
Not on the map. Why?
Abstract (arXiv)
When does 3D Gaussian Splatting (3DGS) recover the true scene surface rather than just overfitting view-dependent appearance? We answer this by developing a mathematical framework based on a first-hit rendering abstraction that cleanly isolates geometry from appearance. We prove that geometric misalignment forcefully converts spatial textures into high-frequency angular signals via parallax. This establishes a strict identifiability window: if angular capacity is bounded, surface-consistent solutions are mathematically preferred; if unrestricted, the same images can be perfectly explained by an incorrect, opaque billboard geometry. Experiments on synthetic stress tests confirm this prediction, showing billboard failures emerge precisely at high angular capacities. Conversely, in the real-world datasets we evaluate under standard capture protocols, reconstructions remain surface-consistent even at high SH degrees, which is consistent with the prediction that rich spatial texture can push billboard solutions outside the tested angular-capacity range.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
29 of 48 references.
References · 29
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
17 more
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 161
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 79
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 67
- 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
- 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Videocited by 25
- 2024GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstructioncited by 19
- 2023MobileBrick: Building LEGO for 3D Reconstruction on Mobile Devicescited by 15
- 2024SolidGS: Consolidating Gaussian Surfel Splatting for Sparse-View Surface Reconstructioncited by 11
- 2025PGC: Physics-Based Gaussian Cloth from a Single Posecited by 11
- 2024MaGS: Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splattingcited by 9
- 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliderscited by 4
- 2024OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentationcited by 3
- 2023Reducing Shape-Radiance Ambiguity in Radiance Fields with a Closed-Form Color Estimation Methodcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.