mlsanityData to 14 Oct 2026

RayOcc: Occlusion-Aware Ray Occupancy Estimation via Gaussian Mixture Intensity

arXiv 2607.17660 ↗First posted 20 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Camera-only 3D semantic occupancy prediction aims to infer voxel-wise scene semantics from multi-view images, yet remains fundamentally challenging due to depth ambiguity and occlusion. Along a single camera ray, multiple spatially separated surfaces may coexist, making occupancy inherently a multi-label existence problem rather than a single-depth estimation task. However, most existing approaches favor a single dominant depth hypothesis per ray, limiting their ability to model volumetric scenes under complex occlusion. To address this limitation, we introduce RayOcc, an occlusion-aware ray occupancy framework that reformulates ray modeling as multi-label existence prediction. Instead of predicting a categorical depth distribution, RayOcc estimates a non-normalized Gaussian mixture intensity along each ray and converts it into interval-wise occupancy probabilities via a Poisson event formulation, allowing multiple occupied hypotheses to coexist without enforcing mutual competition across depth. The predicted mixture components are interpreted as occupancy hypotheses to initialize sparse 3D Gaussian primitives, which are refined and rasterized for semantic occupancy prediction. Experiments on the nuScenes benchmark show that RayOcc achieves state-of-the-art overall IoU and mIoU among the compared Gaussian-based occupancy methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 44 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

38 of 44 references.

References · 38

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  5. 2021Vision Transformers for Dense Predictioncited by 1,803
  6. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  7. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  8. 2024Depth Anything V2cited by 1,422
  9. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  10. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  11. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  12. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
26 more
  1. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
  2. 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
  3. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  4. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  5. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  6. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  7. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
  8. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  9. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  10. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  11. 2023Scene as Occupancycited by 209
  12. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  13. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  14. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  15. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  16. 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
  17. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 103
  18. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
  19. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
  20. 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
  21. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  22. 2023MixNeRF: Modeling a Ray with Mixture Density for Novel View Synthesis from Sparse Inputscited by 40
  23. 2024Occupancy as Set of Pointscited by 38
  24. 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
  25. 2025VG3T: Visual Geometry Grounded Gaussian Transformercited by 4
  26. 2026Rethinking Pose Refinement in 3D Gaussian Splatting under Pose Prior and Geometric Uncertaintycited by 1

Built on by

Not cited yet.