GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
Embodied intelligence requires precise reconstruction and rendering to simulate large-scale real-world data. Although 3D Gaussian Splatting (3DGS) has recently demonstrated high-quality results with real-time performance, it still faces challenges in indoor scenes with large, textureless regions, resulting in incomplete and noisy reconstructions due to poor point cloud initialization and underconstrained optimization. Inspired by the continuity of signed distance field (SDF), which naturally has advantages in modeling surfaces, we propose a unified optimization framework that integrates neural signed distance fields (SDFs) with 3DGS for accurate geometry reconstruction and real-time rendering. This framework incorporates a neural SDF field to guide the densification and pruning of Gaussians, enabling Gaussians to model scenes accurately even with poor initialized point clouds. Simultaneously, the geometry represented by Gaussians improves the efficiency of the SDF field by piloting its point sampling. Additionally, we introduce two regularization terms based on normal and edge priors to resolve geometric ambiguities in textureless areas and enhance detail accuracy. Extensive experiments in ScanNet and ScanNet++ show that our method achieves state-of-the-art performance in both surface reconstruction and novel view synthesis.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 52 of its 71 references that are in the map. First posted on arXiv 30 May 2024.
Builds on
52 of 71 references.
References · 52
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020Neural Sparse Voxel Fieldscited by 959
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
38 more
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 372
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 254
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
- 20213D Neural Scene Representations for Visuomotor Controlcited by 111
- 2015Learning to Compare Image Patches via Convolutional Neural Networkscited by 109
- 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
- 2020Visibility-aware Multi-view Stereo Networkcited by 98
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
- 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 83
- 2022Neural 3D Reconstruction in the Wildcited by 79
- 2022Critical Regularizations for Neural Surface Reconstruction in the Wildcited by 52
- 2024GeoGaussian: Geometry-aware Gaussian Splatting for Scene Renderingcited by 52
- 2017OctNetFusion: Learning Depth Fusion from Datacited by 45
- 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2024: 8; 2025: 17; 2026: 6.
31 papers.
Sort:
By area:
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understandingcited by 16
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstructioncited by 15
- 2025Perceptual-GS: Scene-adaptive Perceptual Densification for Gaussian Splattingcited by 12
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstructioncited by 11
- 20242DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstructioncited by 9
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2026LagerNVS: Latent Geometry for Fully Neural Real-time Novel View Synthesiscited by 9
- 2024GSurf: Learning Signed Distance Fields from Splatting Opaque Gaussians for High-quality 3D Reconstructioncited by 7
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splatscited by 5
- 2024Integrating Meshes and 3D Gaussians for Indoor Scene Reconstruction with SAM Mask Guidancecited by 4
19 more
- 2024GeoTexDensifier: Geometry-Texture-Aware Densification for High-Quality Photorealistic 3D Gaussian Splattingcited by 4
- 2025Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Renderingcited by 4
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussianscited by 4
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenescited by 4
- 2025OmniIndoor3D: Comprehensive Indoor 3D Reconstructioncited by 3
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrievalcited by 3
- 2024Diversity-Driven View Subset Selection for Indoor Novel View Synthesiscited by 2
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splattingcited by 2
- 2025Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenescited by 2
- 2025SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenescited by 1
- 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussianscited by 1
- 2025GSPlane: Concise and Accurate Planar Reconstruction via Structured Representationcited by 1
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
- 2025SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splattingcited by 1
- 2025OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstructioncited by 0
- 2025Leveraging 2D Priors and SDF Guidance for Dynamic Urban Scene Renderingcited by 0
- 2025COREA: Coupled Relightable 3D Gaussians and SDFs for Efficient Normal Alignmentcited by 0
- 2026Gaussian-Voxel Duet: A Dual-Scaffolding Hybrid Representation for Fast and Accurate Monocular Surface Reconstructioncited by 0
- 2026PanoLess: Environment Reconstruction from Partial Reflective Viewscited by 0
- 2026PanoLess: Environment Reconstruction from Partial Reflective Views28 Jul 2026
- 2026Gaussian-Voxel Duet: A Dual-Scaffolding Hybrid Representation for Fast and Accurate Monocular Surface Reconstruction26 May 2026
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval10 May 2026
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenes23 Apr 2026
- 2026LagerNVS: Latent Geometry for Fully Neural Real-time Novel View Synthesis20 Mar 2026
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstruction30 Jan 2026
- 2025COREA: Coupled Relightable 3D Gaussians and SDFs for Efficient Normal Alignment8 Dec 2025
- 2025SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting2 Dec 2025
- 2025Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenes10 Nov 2025
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priors27 Oct 2025
- 2025GSPlane: Concise and Accurate Planar Reconstruction via Structured Representation20 Oct 2025
19 more
- 2025Leveraging 2D Priors and SDF Guidance for Dynamic Urban Scene Rendering15 Oct 2025
- 2025OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstruction29 Sep 2025
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splatting14 Sep 2025
- 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussians13 Aug 2025
- 2025Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering8 Jul 2025
- 2025Perceptual-GS: Scene-adaptive Perceptual Densification for Gaussian Splatting14 Jun 2025
- 2025OmniIndoor3D: Comprehensive Indoor 3D Reconstruction27 May 2025
- 2025SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenes23 May 2025
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstruction29 Mar 2025
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understanding23 Mar 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2024GeoTexDensifier: Geometry-Texture-Aware Densification for High-Quality Photorealistic 3D Gaussian Splatting22 Dec 2024
- 20242DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstruction4 Dec 2024
- 2024GSurf: Learning Signed Distance Fields from Splatting Opaque Gaussians for High-quality 3D Reconstruction24 Nov 2024
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splats23 Nov 2024
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering31 Oct 2024
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Reality21 Sep 2024
- 2024Diversity-Driven View Subset Selection for Indoor Novel View Synthesis11 Sep 2024
- 2024Integrating Meshes and 3D Gaussians for Indoor Scene Reconstruction with SAM Mask Guidance23 Jul 2024
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understandingcited by 16
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstructioncited by 15
- 2025Perceptual-GS: Scene-adaptive Perceptual Densification for Gaussian Splattingcited by 12
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstructioncited by 11
- 20242DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstructioncited by 9
- 2026LagerNVS: Latent Geometry for Fully Neural Real-time Novel View Synthesiscited by 9
- 2024GSurf: Learning Signed Distance Fields from Splatting Opaque Gaussians for High-quality 3D Reconstructioncited by 7
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splatscited by 5
- 2024Integrating Meshes and 3D Gaussians for Indoor Scene Reconstruction with SAM Mask Guidancecited by 4
- 2024GeoTexDensifier: Geometry-Texture-Aware Densification for High-Quality Photorealistic 3D Gaussian Splattingcited by 4
12 most cited of 30 All 30 (JSON)
- 2026PanoLess: Environment Reconstruction from Partial Reflective Views28 Jul 2026
- 2026Gaussian-Voxel Duet: A Dual-Scaffolding Hybrid Representation for Fast and Accurate Monocular Surface Reconstruction26 May 2026
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval10 May 2026
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenes23 Apr 2026
- 2026LagerNVS: Latent Geometry for Fully Neural Real-time Novel View Synthesis20 Mar 2026
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstruction30 Jan 2026
- 2025COREA: Coupled Relightable 3D Gaussians and SDFs for Efficient Normal Alignment8 Dec 2025
- 2025SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting2 Dec 2025
- 2025Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenes10 Nov 2025
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priors27 Oct 2025
- 2025GSPlane: Concise and Accurate Planar Reconstruction via Structured Representation20 Oct 2025
12 newest of 30 All 30 (JSON)