Dr.Occ: Depth- and Region-Guided 3D Occupancy from Surround-View Cameras for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
3D semantic occupancy prediction is crucial for autonomous driving perception, offering comprehensive geometric scene understanding and semantic recognition. However, existing methods struggle with geometric misalignment in view transformation due to the lack of pixel-level accurate depth estimation, and severe spatial class imbalance where semantic categories exhibit strong spatial anisotropy. To address these challenges, we propose Dr. Occ, a depth- and region-guided occupancy prediction framework. Specifically, we introduce a depth-guided 2D-to-3D View Transformer (D2-VFormer) that effectively leverages high-quality dense depth cues from MoGe-2 to construct reliable geometric priors, thereby enabling precise geometric alignment of voxel features. Moreover, inspired by the Mixture-of-Experts (MoE) framework, we propose a region-guided Expert Transformer (R/R2-EFormer) that adaptively allocates region-specific experts to focus on different spatial regions, effectively addressing spatial semantic variations. Thus, the two components make complementary contributions: depth guidance ensures geometric alignment, while region experts enhance semantic learning. Experiments on the Occ3D--nuScenes benchmark demonstrate that Dr. Occ improves the strong baseline BEVDet4D by 7.43% mIoU and 3.09% IoU under the full vision-only setting.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 34 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
30 of 34 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022Mixture-of-Experts with Expert Choice Routingcited by 611
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
18 more
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2025Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computationcited by 120
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
- 2023FB-BEV: BEV Representation from Forward-Backward View Transformationscited by 98
- 2022Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignmentcited by 96
- 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
- 2024Occupancy as Set of Pointscited by 37
- 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 36
- 2024Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecastingcited by 6
- 2025Diffusion-Based Generative Models for 3D Occupancy Prediction in Autonomous Drivingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025OccLE: Label-Efficient 3D Semantic Occupancy Prediction
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Driving
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving
- 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction
- 2024SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIs
- 2025HD2-SSC: High-Dimension High-Density Semantic Scene Completion for Autonomous Driving
- 2023RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting