Disentangling Instance and Scene Contexts for 3D Semantic Scene Completion
Not on the map. Why?
Abstract (arXiv)
3D Semantic Scene Completion (SSC) has gained increasing attention due to its pivotal role in 3D perception. Recent advancements have primarily focused on refining voxel-level features to construct 3D scenes. However, treating voxels as the basic interaction units inherently limits the utilization of class-level information, which is proven critical for enhancing the granularity of completion results. To address this, we propose Disentangling Instance and Scene Contexts (DISC), a novel dual-stream paradigm that enhances learning for both instance and scene categories through separated optimization. Specifically, we replace voxel queries with discriminative class queries, which incorporate class-specific geometric and semantic priors. Additionally, we exploit the intrinsic properties of classes to design specialized decoding modules, facilitating targeted interactions and efficient class-level information flow. Experimental results demonstrate that DISC achieves state-of-the-art (SOTA) performance on both SemanticKITTI and SSCBench-KITTI-360 benchmarks, with mIoU scores of 17.35 and 20.55, respectively. Remarkably, DISC even outperforms multi-frame SOTA methods using only single-frame input and significantly improves instance category performance, surpassing both single-frame and multi-frame SOTA instance mIoU by 17.9% and 11.9%, respectively, on the SemanticKITTI hidden test. The code is available at https://github.com/Enyu-Liu/DISC.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
43 of 51 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 327
31 more
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2021Translating Images into Mapscited by 115
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 103
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 86
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 75
- 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 44
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
- 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
- 2024TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenescited by 40
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
- 2023SA-BEV: Generating Semantic-Aware Bird's-Eye-View Feature for Multi-view 3D Object Detectioncited by 30
- 2022GitNet: Geometric Prior-based Transformation for Birds-Eye-View Segmentationcited by 24
- 2024Delving into the Trajectory Long-tail Distribution for Muti-object Trackingcited by 18
- 2024BEVSpread: Spread Voxel Pooling for Bird's-Eye-View Representation in Vision-based Roadside 3D Object Detectioncited by 15
- 2024Cross-View Referring Multi-Object Trackingcited by 12
- 2025OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformercited by 11
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025OneOcc: Semantic Occupancy Prediction for Legged Robots with a Single Panoramic Cameracited by 8
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspectivecited by 5
- 2025VOIC: Visible-Occluded Integrated Guidance for 3D Semantic Scene Completioncited by 0
- 2026ProOOD: Prototype-Guided Out-of-Distribution 3D Occupancy Predictioncited by 0
- 2026Sparsity-Aware Voxel Attention and Foreground Modulation for 3D Semantic Scene Completioncited by 0
- 2026Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillationcited by 0
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environmentscited by 0
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environments2 Oct 2026
- 2026Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillation27 May 2026
- 2026Sparsity-Aware Voxel Attention and Foreground Modulation for 3D Semantic Scene Completion7 Apr 2026
- 2026ProOOD: Prototype-Guided Out-of-Distribution 3D Occupancy Prediction1 Apr 2026
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspective23 Dec 2025
- 2025VOIC: Visible-Occluded Integrated Guidance for 3D Semantic Scene Completion22 Dec 2025
- 2025OneOcc: Semantic Occupancy Prediction for Legged Robots with a Single Panoramic Camera5 Nov 2025