mlsanityData to 14 Oct 2026

GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction

arXiv 2405.19671 ↗First posted 30 May 2024cs.CVcited by 31

Not on the map. Why?

Abstract (arXiv)

Embodied intelligence requires precise reconstruction and rendering to simulate large-scale real-world data. Although 3D Gaussian Splatting (3DGS) has recently demonstrated high-quality results with real-time performance, it still faces challenges in indoor scenes with large, textureless regions, resulting in incomplete and noisy reconstructions due to poor point cloud initialization and underconstrained optimization. Inspired by the continuity of signed distance field (SDF), which naturally has advantages in modeling surfaces, we propose a unified optimization framework that integrates neural signed distance fields (SDFs) with 3DGS for accurate geometry reconstruction and real-time rendering. This framework incorporates a neural SDF field to guide the densification and pruning of Gaussians, enabling Gaussians to model scenes accurately even with poor initialized point clouds. Simultaneously, the geometry represented by Gaussians improves the efficiency of the SDF field by piloting its point sampling. Additionally, we introduce two regularization terms based on normal and edge priors to resolve geometric ambiguities in textureless areas and enhance detail accuracy. Extensive experiments in ScanNet and ScanNet++ show that our method achieves state-of-the-art performance in both surface reconstruction and novel view synthesis.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 52 of its 71 references that are in the map. First posted on arXiv 30 May 2024.

Builds on

52 of 71 references.

References · 52

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  7. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  8. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  9. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  10. 2020Neural Sparse Voxel Fieldscited by 959
  11. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  12. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
38 more
  1. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  2. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  3. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  4. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  5. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  6. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  7. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  8. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  9. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  10. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  11. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
  12. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 372
  13. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  14. 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 254
  15. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  16. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  17. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  18. 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
  19. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
  20. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
  21. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
  22. 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
  23. 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
  24. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
  25. 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
  26. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  27. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  28. 20213D Neural Scene Representations for Visuomotor Controlcited by 111
  29. 2015Learning to Compare Image Patches via Convolutional Neural Networkscited by 109
  30. 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
  31. 2020Visibility-aware Multi-view Stereo Networkcited by 98
  32. 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
  33. 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 83
  34. 2022Neural 3D Reconstruction in the Wildcited by 79
  35. 2022Critical Regularizations for Neural Surface Reconstruction in the Wildcited by 52
  36. 2024GeoGaussian: Geometry-aware Gaussian Splatting for Scene Renderingcited by 52
  37. 2017OctNetFusion: Learning Depth Fusion from Datacited by 45
  38. 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 17; 2026: 6.

31 papers.

Sort:

By area:

  1. 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 43
  2. 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
  3. 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understandingcited by 16
  4. 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstructioncited by 15
  5. 2025Perceptual-GS: Scene-adaptive Perceptual Densification for Gaussian Splattingcited by 12
  6. 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstructioncited by 11
  7. 20242DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstructioncited by 9
  8. 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
  9. 2026LagerNVS: Latent Geometry for Fully Neural Real-time Novel View Synthesiscited by 9
  10. 2024GSurf: Learning Signed Distance Fields from Splatting Opaque Gaussians for High-quality 3D Reconstructioncited by 7
  11. 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splatscited by 5
  12. 2024Integrating Meshes and 3D Gaussians for Indoor Scene Reconstruction with SAM Mask Guidancecited by 4
19 more
  1. 2024GeoTexDensifier: Geometry-Texture-Aware Densification for High-Quality Photorealistic 3D Gaussian Splattingcited by 4
  2. 2025Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Renderingcited by 4
  3. 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussianscited by 4
  4. 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenescited by 4
  5. 2025OmniIndoor3D: Comprehensive Indoor 3D Reconstructioncited by 3
  6. 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrievalcited by 3
  7. 2024Diversity-Driven View Subset Selection for Indoor Novel View Synthesiscited by 2
  8. 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splattingcited by 2
  9. 2025Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenescited by 2
  10. 2025SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenescited by 1
  11. 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussianscited by 1
  12. 2025GSPlane: Concise and Accurate Planar Reconstruction via Structured Representationcited by 1
  13. 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
  14. 2025SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splattingcited by 1
  15. 2025OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstructioncited by 0
  16. 2025Leveraging 2D Priors and SDF Guidance for Dynamic Urban Scene Renderingcited by 0
  17. 2025COREA: Coupled Relightable 3D Gaussians and SDFs for Efficient Normal Alignmentcited by 0
  18. 2026Gaussian-Voxel Duet: A Dual-Scaffolding Hybrid Representation for Fast and Accurate Monocular Surface Reconstructioncited by 0
  19. 2026PanoLess: Environment Reconstruction from Partial Reflective Viewscited by 0