mlsanityData to 7 Oct 2026

OPUS-V2: Bridging the Gap between Sparse Points and Dense Voxels

arXiv 2608.29187 ↗First posted 29 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The point-based occupancy prediction paradigm has achieved an attractive trade-off between accuracy and efficiency by modeling 3D space sparsely. However, its predictions inherently mismatch the dense voxel-based occupancy required by self-driving systems, necessitating hand-crafted heuristics during training and inference that limit final performance. To overcome these limitations, we propose OPUS-V2, a novel framework built upon the pioneering OPUS (occupancy prediction using a sparse set) point-based approach. OPUS-V2 incorporates a lightweight point-voxel transformation (PVT) module behind the decoder to adaptively map sparse predictions into the dense voxel space, eliminating the need for suboptimal operations and improving model accuracy. Furthermore, our architecture decouples feature and occupancy generation processes, allowing OPUS-V2 to adapt to arbitrary occupancy resolutions. OPUS-V2 achieves a state-of-the-art rayIoU of 44.0 on the Occ3D dataset. On the more challenging OpenOccupancy dataset, it attains a competitive 16.4 mIoU while running in real time at 20.6 FPS.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 63 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

51 of 63 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  8. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  9. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  10. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  11. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  12. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
38 more
  1. 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
  2. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  3. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
  4. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 485
  5. 2021Conditional DETR for Fast Training Convergencecited by 422
  6. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  7. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  8. 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
  9. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  10. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  11. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  12. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  13. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
  14. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
  15. 2023Scene as Occupancycited by 208
  16. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  17. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  18. 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 161
  19. 2020Rethinking Transformer-based Set Prediction for Object Detectioncited by 156
  20. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  21. 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
  22. 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 126
  23. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
  24. 20203D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Priorcited by 124
  25. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
  26. 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
  27. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 94
  28. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
  29. 2023Fully Sparse 3D Occupancy Predictioncited by 61
  30. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  31. 2014Spatially-sparse convolutional neural networkscited by 33
  32. 2024GaussianAD: Gaussian-Centric End-to-End Autonomous Drivingcited by 31
  33. 2025STCOcc: Sparse Spatial-Temporal Cascade Renovation for 3D Occupancy and Scene Flow Predictioncited by 20
  34. 2024ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictionscited by 19
  35. 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Predictioncited by 15
  36. 2024Panoptic-FlashOcc: An Efficient Baseline to Marry Semantic Occupancy with Panoptic via Instance Centercited by 14
  37. 2025SparseWorld: A Flexible, Adaptive, and Efficient 4D Occupancy World Model Powered by Sparse and Dynamic Queriescited by 10
  38. 2025ODG: Occupancy Prediction Using Dual Gaussianscited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.