OccLE: Label-Efficient 3D Semantic Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
3D semantic occupancy prediction offers an intuitive and efficient scene understanding and has attracted significant interest in autonomous driving perception. Existing approaches either rely on full supervision, which demands costly voxel-level annotations, or on self-supervision, which provides limited guidance and yields suboptimal performance. To address these challenges, we propose OccLE, a Label-Efficient 3D Semantic Occupancy Prediction that takes images and LiDAR as inputs and maintains high performance with limited voxel annotations. Our intuition is to decouple the semantic and geometric learning tasks and then fuse the learned feature grids from both tasks for the final semantic occupancy prediction. Therefore, the semantic branch distills 2D foundation model to provide aligned pseudo labels for 2D and 3D semantic learning. The geometric branch integrates image and LiDAR inputs in cross-plane synergy based on their inherency, employing semi-supervision to enhance geometry learning. We fuse semantic-geometric feature grids through Dual Mamba and incorporate a scatter-accumulated projection to supervise unannotated prediction with aligned pseudo labels. Experiments show that OccLE achieves competitive performance with only 10% of voxel annotations on the SemanticKITTI and Occ3D-nuScenes datasets. The code will be publicly released on https://github.com/NerdFNY/OccLE
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 57 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
47 of 57 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
35 more
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2018ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Networkcited by 90
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 75
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
- 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
- 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 41
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
- 2024DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Featurescited by 33
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
- 2024OccMamba: Semantic Occupancy Prediction with State Space Modelscited by 30
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Drivingcited by 29
- 2024OccFlowNet: Towards Self-supervised Occupancy Estimation via Differentiable Rendering and Occupancy Flowcited by 22
- 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Predictioncited by 15
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attentioncited by 14
- 2024OccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Predictioncited by 13
- 2024PanoSSC: Exploring Monocular Panoptic 3D Scene Reconstruction for Autonomous Drivingcited by 9
- 2023A Cross-Scale Hierarchical Transformer with Correspondence-Augmented Attention for inferring Bird's-Eye-View Semantic Segmentationcited by 7
- 2024OccLoff: Learning Optimized Feature Fusion for 3D Occupancy Predictioncited by 7
- 2024LightOcc: Lightweight Spatial Embedding for Efficient Vision-based 3D Occupancy Predictioncited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Dr.Occ: Depth- and Region-Guided 3D Occupancy from Surround-View Cameras for Autonomous Driving
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving
- 2023Scene as Occupancy
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting
- 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction
- 2023OVO: Open-Vocabulary Occupancy
- 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mamba
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving