Unleashing Semantic and Geometric Priors for 3D Scene Completion
Not on the map. Why?
Abstract (arXiv)
Camera-based 3D semantic scene completion (SSC) provides dense geometric and semantic perception for autonomous driving and robotic navigation. However, existing methods rely on a coupled encoder to deliver both semantic and geometric priors, which forces the model to make a trade-off between conflicting demands and limits its overall performance. To tackle these challenges, we propose FoundationSSC, a novel framework that performs dual decoupling at both the source and pathway levels. At the source level, we introduce a foundation encoder that provides rich semantic feature priors for the semantic branch and high-fidelity stereo cost volumes for the geometric branch. At the pathway level, these priors are refined through specialised, decoupled pathways, yielding superior semantic context and depth distributions. Our dual-decoupling design produces disentangled and refined inputs, which are then utilised by a hybrid view transformation to generate complementary 3D features. Additionally, we introduce a novel Axis-Aware Fusion (AAF) module that addresses the often-overlooked challenge of fusing these features by anisotropically merging them into a unified representation. Extensive experiments demonstrate the advantages of FoundationSSC, achieving simultaneous improvements in both semantic and geometric metrics, surpassing prior bests by +0.23 mIoU and +2.03 IoU on SemanticKITTI. Additionally, we achieve state-of-the-art performance on SSCBench-KITTI-360, with 21.78 mIoU and 48.61 IoU.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 19 Aug 2025.
Builds on
28 of 40 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
16 more
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2020Attentional Feature Fusioncited by 115
- 2023FB-BEV: BEV Representation from Forward-Backward View Transformationscited by 98
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2024Improving 2D Feature Representations by 3D-Aware Fine-Tuningcited by 70
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
- 2025DFormerv2: Geometry Self-Attention for RGBD Semantic Segmentationcited by 30
- 2023Bridging Stereo Geometry and BEV Representation with Reliable Mutual Interaction for Semantic Scene Completioncited by 21
- 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mambacited by 8
- 2025VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completioncited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.