mlsanityData to 7 Oct 2026

VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding

arXiv 2605.25059 ↗First posted 24 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Crucial for autonomous exploration, online 3D occupancy prediction and mapping incrementally construct dense spatial representations on the fly. Embodied online occupancy prediction remains predominantly Gaussian-centric, despite the wide use of voxel representations for frame-wise scene completion. We present VEOcc, to the best of our knowledge, the first voxel-centric framework for online embodied semantic occupancy prediction. It incrementally maintains a sparse global semantic voxel map from monocular observations and enables open-ended expansion without predefined scene bounds. To robustly integrate noisy multi-view predictions, we further introduce a Spatio-Temporal-Aware Online Update Strategy comprising Cross-Temporal Logit Aggregation (TLA) for short-term temporal consistency, Reliability-Aware Confidence Modulation (RCM) for spatial uncertainty calibration, and Confidence-Driven Incremental State Update (CSU) for robust global state assimilation. Extensive experiments on Occ-ScanNet and EmbodiedOcc-ScanNet demonstrate state-of-the-art performance among models of comparable scale in both local and embodied settings. Moreover, onboard deployment on a mobile robot validates practical online operation and long-horizon scalability, while results on self-collected handheld sequences demonstrate zero-shot generalization to unseen real-world environments. Code and supplementary visualizations are available on our project page: https://wryzju.github.io/VEOcc/.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 24 May 2026.

Builds on

34 of 41 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  5. 2024Depth Anything V2cited by 1,385
  6. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  7. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  8. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  10. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  11. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  12. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
22 more
  1. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  2. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  3. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
  4. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  5. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  6. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
  7. 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
  8. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
  9. 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligencecited by 35
  10. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
  11. 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
  12. 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 26
  13. 2025GaussianFlowOcc: Sparse and Weakly Supervised Occupancy Estimation using Gaussian Splatting and Temporal Flowcited by 24
  14. 2025RoboOcc: Enhancing the Geometric and Semantic Scene Understanding for Robotscited by 15
  15. 2025VoxDet: Rethinking 3D Semantic Occupancy Prediction as Dense Object Detectioncited by 12
  16. 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Predictioncited by 9
  17. 2022A Review on Visual-SLAM: Advancements from Geometric Modelling to Learning-based Semantic Scene Understandingcited by 8
  18. 2025L2COcc: Lightweight Camera-Centric Semantic Scene Completion via Distillation of LiDAR Modelcited by 8
  19. 2025SplatSSC: Decoupled Depth-Guided Gaussian Splatting for Semantic Scene Completioncited by 7
  20. 2025ODG: Occupancy Prediction Using Dual Gaussianscited by 3
  21. 2025TGSFormer: Scalable Temporal Gaussian Splatting for Embodied Semantic Scene Completioncited by 2
  22. 2026VGGT-Occ: Geometry-Grounded and Density-Aware Gated Fusion for 3D Occupancy Predictioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.