SplatSSC: Decoupled Depth-Guided Gaussian Splatting for Semantic Scene Completion
Not on the map. Why?
Abstract (arXiv)
Monocular 3D Semantic Scene Completion (SSC) is a challenging yet promising task that aims to infer dense geometric and semantic descriptions of a scene from a single image. While recent object-centric paradigms significantly improve efficiency by leveraging flexible 3D Gaussian primitives, they still rely heavily on a large number of randomly initialized primitives, which inevitably leads to 1) inefficient primitive initialization and 2) outlier primitives that introduce erroneous artifacts. In this paper, we propose SplatSSC, a novel framework that resolves these limitations with a depth-guided initialization strategy and a principled Gaussian aggregator. Instead of random initialization, SplatSSC utilizes a dedicated depth branch composed of a Group-wise Multi-scale Fusion (GMF) module, which integrates multi-scale image and depth features to generate a sparse yet representative set of initial Gaussian primitives. To mitigate noise from outlier primitives, we develop the Decoupled Gaussian Aggregator (DGA), which enhances robustness by decomposing geometric and semantic predictions during the Gaussian-to-voxel splatting process. Complemented with a specialized Probability Scale Loss, our method achieves state-of-the-art performance on the Occ-ScanNet dataset, outperforming prior approaches by over 6.3% in IoU and 4.1% in mIoU, while reducing both latency and memory cost by more than 9.3%.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 43 of its 57 references that are in the map. First posted on arXiv 4 Aug 2025.
Builds on
43 of 57 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
31 more
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
- 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 127
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 103
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 86
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
- 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 63
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2019RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completioncited by 55
- 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 45
- 2019Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completioncited by 43
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2021Semantic Segmentation-assisted Scene Completion for LiDAR Point Cloudscited by 37
- 2019ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Imagecited by 32
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 31
- 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 27
- 2025RoboOcc: Enhancing the Geometric and Semantic Scene Understanding for Robotscited by 15
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attentioncited by 14
- 2025VPGS-SLAM: Voxel-based Progressive 3D Gaussian SLAM in Large-Scale Scenescited by 13
- 2023Semantic Scene Completion with Cleaner Selfcited by 12
- 2025GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyondcited by 12
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
- 2023Gated Cross-Attention Network for Depth Completioncited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2026Monocular Open Vocabulary Occupancy Prediction for Indoor Scenescited by 5
- 2025TGSFormer: Scalable Temporal Gaussian Splatting for Embodied Semantic Scene Completioncited by 2
- 2026VGGT-Occ: Geometry-Grounded and Density-Aware Gated Fusion for 3D Occupancy Predictioncited by 1
- 2026VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understandingcited by 1
- 2026FLM-Occ: Feed-forward Likelihood Maximization for Efficient Indoor Occupancy Predictioncited by 1
- 2026OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Predictioncited by 0
- 2026AdaOcc: Adaptive 3D Occupancy Prediction for Embodied Taskscited by 0
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environmentscited by 0
- 2026GNFormer: Gaussian Neural Field Transformer for Efficient Camera-based Occupancy Predictioncited by 0
- 2026GNFormer: Gaussian Neural Field Transformer for Efficient Camera-based Occupancy Prediction11 Oct 2026
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environments2 Oct 2026
- 2026AdaOcc: Adaptive 3D Occupancy Prediction for Embodied Tasks30 Sep 2026
- 2026OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Prediction9 Aug 2026
- 2026FLM-Occ: Feed-forward Likelihood Maximization for Efficient Indoor Occupancy Prediction19 Jun 2026
- 2026VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding24 May 2026
- 2026VGGT-Occ: Geometry-Grounded and Density-Aware Gated Fusion for 3D Occupancy Prediction16 May 2026
- 2026Monocular Open Vocabulary Occupancy Prediction for Indoor Scenes26 Feb 2026
- 2025TGSFormer: Scalable Temporal Gaussian Splatting for Embodied Semantic Scene Completion29 Nov 2025