mlsanityData to 14 Oct 2026

OccLE: Label-Efficient 3D Semantic Occupancy Prediction

arXiv 2505.20617 ↗First posted 27 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D semantic occupancy prediction offers an intuitive and efficient scene understanding and has attracted significant interest in autonomous driving perception. Existing approaches either rely on full supervision, which demands costly voxel-level annotations, or on self-supervision, which provides limited guidance and yields suboptimal performance. To address these challenges, we propose OccLE, a Label-Efficient 3D Semantic Occupancy Prediction that takes images and LiDAR as inputs and maintains high performance with limited voxel annotations. Our intuition is to decouple the semantic and geometric learning tasks and then fuse the learned feature grids from both tasks for the final semantic occupancy prediction. Therefore, the semantic branch distills 2D foundation model to provide aligned pseudo labels for 2D and 3D semantic learning. The geometric branch integrates image and LiDAR inputs in cross-plane synergy based on their inherency, employing semi-supervision to enhance geometry learning. We fuse semantic-geometric feature grids through Dual Mamba and incorporate a scatter-accumulated projection to supervise unannotated prediction with aligned pseudo labels. Experiments show that OccLE achieves competitive performance with only 10% of voxel annotations on the SemanticKITTI and Occ3D-nuScenes datasets. The code will be publicly released on https://github.com/NerdFNY/OccLE

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 57 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

47 of 57 references.

References · 47

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  5. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  8. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  9. 2016Semantic Scene Completion from a Single Depth Imagecited by 472
  10. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  11. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
  12. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
35 more
  1. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  2. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  3. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  4. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  5. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  6. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  7. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
  8. 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
  9. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  10. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  11. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  12. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
  13. 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
  14. 2018ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Networkcited by 90
  15. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
  16. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
  17. 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 75
  18. 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
  19. 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
  20. 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
  21. 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 41
  22. 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
  23. 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
  24. 2024DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Featurescited by 33
  25. 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
  26. 2024OccMamba: Semantic Occupancy Prediction with State Space Modelscited by 30
  27. 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Drivingcited by 29
  28. 2024OccFlowNet: Towards Self-supervised Occupancy Estimation via Differentiable Rendering and Occupancy Flowcited by 22
  29. 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Predictioncited by 15
  30. 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attentioncited by 14
  31. 2024OccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Predictioncited by 13
  32. 2024PanoSSC: Exploring Monocular Panoptic 3D Scene Reconstruction for Autonomous Drivingcited by 9
  33. 2023A Cross-Scale Hierarchical Transformer with Correspondence-Augmented Attention for inferring Bird's-Eye-View Semantic Segmentationcited by 7
  34. 2024OccLoff: Learning Optimized Feature Fusion for 3D Occupancy Predictioncited by 7
  35. 2024LightOcc: Lightweight Spatial Embedding for Efficient Vision-based 3D Occupancy Predictioncited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dr.Occ: Depth- and Region-Guided 3D Occupancy from Surround-View Cameras for Autonomous Driving
  2. 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving
  3. 2023Scene as Occupancy
  4. 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting
  5. 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction
  6. 2023OVO: Open-Vocabulary Occupancy
  7. 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mamba
  8. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving