Improving 3D Occupancy Prediction through Class-balancing Loss and Multi-scale Representation
Not on the map. Why?
Abstract (arXiv)
3D environment recognition is essential for autonomous driving systems, as autonomous vehicles require a comprehensive understanding of surrounding scenes. Recently, the predominant approach to define this real-life problem is through 3D occupancy prediction. It attempts to predict the occupancy states and semantic labels for all voxels in 3D space, which enhances the perception capability. Birds-Eye-View(BEV)-based perception has achieved the SOTA performance for this task. Nonetheless, this architecture fails to represent various scales of BEV features. In this paper, inspired by the success of UNet in semantic segmentation tasks, we introduce a novel UNet-like Multi-scale Occupancy Head module to relieve this issue. Furthermore, we propose the class-balancing loss to compensate for rare classes in the dataset. The experimental results on nuScenes 3D occupancy challenge dataset show the superiority of our proposed approach over baseline and SOTA methods.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 25 May 2024.
Builds on
15 of 23 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
Built on by
Citing papers per year: 2024: 1.
1 paper.