Rebenchmarking Unsupervised Monocular 3D Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
Inferring the 3D structure from a single image, particularly in occluded regions, remains a fundamental yet unsolved challenge in vision-centric autonomous driving. Existing unsupervised approaches typically train a neural radiance field and treat the network outputs as occupancy probabilities during evaluation, overlooking the inconsistency between training and evaluation protocols. Moreover, the prevalent use of 2D ground truth fails to reveal the inherent ambiguity in occluded regions caused by insufficient geometric constraints. To address these issues, this paper presents a reformulated benchmark for unsupervised monocular 3D occupancy prediction. We first interpret the variables involved in the volume rendering process and identify the most physically consistent representation of the occupancy probability. Building on these analyses, we improve existing evaluation protocols by aligning the newly identified representation with voxel-wise 3D occupancy ground truth, thereby enabling unsupervised methods to be evaluated in a manner consistent with that of supervised approaches. Additionally, to impose explicit constraints in occluded regions, we introduce an occlusion-aware polarization mechanism that incorporates multi-view visual cues to enhance discrimination between occupied and free spaces in these regions. Extensive experiments demonstrate that our approach not only significantly outperforms existing unsupervised approaches but also matches the performance of supervised ones. Our source code and evaluation protocol will be made available upon publication.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
40 of 51 references.
References · 40
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2022Language-driven Semantic Segmentationcited by 711
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
28 more
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
- 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 66
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2022SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fieldscited by 49
- 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecastingcited by 40
- 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 39
- 2021PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Losscited by 31
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
- 2024OccMamba: Semantic Occupancy Prediction with State Space Modelscited by 29
- 2025UniOcc: A Unified Benchmark for Occupancy Forecasting and Prediction in Autonomous Drivingcited by 27
- 2025GaussRender: Learning 3D Occupancy with Gaussian Renderingcited by 17
- 2024Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoningcited by 12
- 2024DCPI-Depth: Explicitly Infusing Dense Correspondence Prior to Unsupervised Monocular Depth Estimationcited by 12
- 2025Feed-Forward SceneDINO for Unsupervised Semantic Scene Completioncited by 11
- 2024ViPOcc: Leveraging Visual Priors from Vision Foundation Models for Single-View 3D Occupancy Predictioncited by 8
- 2024Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillationcited by 6
- 2024Alpha Invariance: On Inverse Scaling Between Distance and Volume Density in Neural Radiance Fieldscited by 1
Built on by
Not cited yet.