mlsanityData to 14 Oct 2026

SplatSSC: Decoupled Depth-Guided Gaussian Splatting for Semantic Scene Completion

arXiv 2508.02261 ↗First posted 4 Aug 2025cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Monocular 3D Semantic Scene Completion (SSC) is a challenging yet promising task that aims to infer dense geometric and semantic descriptions of a scene from a single image. While recent object-centric paradigms significantly improve efficiency by leveraging flexible 3D Gaussian primitives, they still rely heavily on a large number of randomly initialized primitives, which inevitably leads to 1) inefficient primitive initialization and 2) outlier primitives that introduce erroneous artifacts. In this paper, we propose SplatSSC, a novel framework that resolves these limitations with a depth-guided initialization strategy and a principled Gaussian aggregator. Instead of random initialization, SplatSSC utilizes a dedicated depth branch composed of a Group-wise Multi-scale Fusion (GMF) module, which integrates multi-scale image and depth features to generate a sparse yet representative set of initial Gaussian primitives. To mitigate noise from outlier primitives, we develop the Decoupled Gaussian Aggregator (DGA), which enhances robustness by decomposing geometric and semantic predictions during the Gaussian-to-voxel splatting process. Complemented with a specialized Probability Scale Loss, our method achieves state-of-the-art performance on the Occ-ScanNet dataset, outperforming prior approaches by over 6.3% in IoU and 4.1% in mIoU, while reducing both latency and memory cost by more than 9.3%.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 43 of its 57 references that are in the map. First posted on arXiv 4 Aug 2025.

Builds on

43 of 57 references.

References · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  7. 2016Semantic Scene Completion from a Single Depth Imagecited by 472
  8. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
  9. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  10. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  11. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  12. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
31 more
  1. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
  2. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
  3. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  4. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  5. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
  6. 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 127
  7. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
  8. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 103
  9. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  10. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
  11. 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 86
  12. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
  13. 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 63
  14. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  15. 2019RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completioncited by 55
  16. 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
  17. 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
  18. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 45
  19. 2019Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completioncited by 43
  20. 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
  21. 2021Semantic Segmentation-assisted Scene Completion for LiDAR Point Cloudscited by 37
  22. 2019ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Imagecited by 32
  23. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 31
  24. 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 27
  25. 2025RoboOcc: Enhancing the Geometric and Semantic Scene Understanding for Robotscited by 15
  26. 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attentioncited by 14
  27. 2025VPGS-SLAM: Voxel-based Progressive 3D Gaussian SLAM in Large-Scale Scenescited by 13
  28. 2023Semantic Scene Completion with Cleaner Selfcited by 12
  29. 2025GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyondcited by 12
  30. 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
  31. 2023Gated Cross-Attention Network for Depth Completioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.