AdaOcc: Adaptive-Resolution Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
Autonomous driving in complex urban scenarios requires 3D perception to be both comprehensive and precise. Traditional 3D perception methods focus on object detection, resulting in sparse representations that lack environmental detail. Recent approaches estimate 3D occupancy around vehicles for a more comprehensive scene representation. However, dense 3D occupancy prediction increases computational demands, challenging the balance between efficiency and resolution. High-resolution occupancy grids offer accuracy but demand substantial computational resources, while low-resolution grids are efficient but lack detail. To address this dilemma, we introduce AdaOcc, a novel adaptive-resolution, multi-modal prediction approach. Our method integrates object-centric 3D reconstruction and holistic occupancy prediction within a single framework, performing highly detailed and precise 3D reconstruction only in regions of interest (ROIs). These high-detailed 3D surfaces are represented in point clouds, thus their precision is not constrained by the predefined grid resolution of the occupancy map. We conducted comprehensive experiments on the nuScenes dataset, demonstrating significant improvements over existing methods. In close-range scenarios, we surpass previous baselines by over 13% in IOU, and over 40% in Hausdorff distance. In summary, AdaOcc offers a more versatile and effective framework for delivering accurate 3D semantic occupancy prediction across diverse driving scenarios.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 51 references that are in the map. First posted on arXiv 24 Aug 2024.
Builds on
39 of 51 references.
References · 39
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Gaussian Splatting SLAMcited by 415
27 more
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 221
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2023Scene as Occupancycited by 209
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
- 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 162
- 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
- 2022M2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representationcited by 156
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 86
- 2022Polar Parametrization for Vision-based Surround-View 3D Detectioncited by 53
- 2021Multiresolution Deep Implicit Functions for 3D Shape Representationcited by 35
- 2022DETR4D: Direct Multi-View 3D Object Detection with Sparse Attentioncited by 21
- 2023Fast-BEV: Towards Real-time On-vehicle Bird's-Eye View Perceptioncited by 18
- 2022A Simple Baseline for Multi-Camera 3D Object Detectioncited by 16
- 2020A generalized Hausdorff distance based quality metric for point cloud geometrycited by 15
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objectscited by 12
- 2024Behind the Veil: Enhanced Indoor 3D Scene Reconstruction with Occluded Surfaces Completioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.