mlsanityData to 14 Oct 2026

PanOVOcc: Panoramic Embodied Open-Vocabulary Occupancy Mapping with Long-term Spatial Voxel Memory

arXiv 2609.31716 ↗First posted 21 Sep 2026cs.CV cs.RO eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Persistent semantic occupancy mapping is essential for embodied scene understanding. However, perspective-based systems provide limited spatial coverage, while existing panoramic methods primarily predict local volumes from single observations. We introduce PanOVOcc, a training-free framework for persistent open-vocabulary semantic occupancy mapping from panoramic sequences. PanOVOcc unifies panoramic SLAM, open-vocabulary perception, and long-term spatial voxel memory within an online architecture, continuously integrating geometric and semantic evidence into a global, language-queryable map. To facilitate systematic evaluation of this setting, we establish Pan-Replica and Pan-Holo360D, two benchmarks pairing continuous panoramic RGB-D sequences with scene-level semantic occupancy ground truth across synthetic and real-world scenes. Compared with the strongest evaluated baseline for each metric, PanOVOcc improves occupancy IoU and semantic mIoU by absolute +20.03 and +7.06 on Pan-Replica, and by +43.26 and +20.16 on Pan-Holo360D, respectively. The source code and the established benchmarks will be available at https://github.com/bakereet/PanOVOcc.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

36 of 43 references.

References · 36

  1. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  2. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
  3. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  4. 2022Visual Language Maps for Robot Navigationcited by 365
  5. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  6. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 304
  7. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
  8. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
  9. 2020HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Featurescited by 105
  10. 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 77
  11. 2019OpenVSLAM: A Versatile Visual SLAM Frameworkcited by 64
  12. 2020MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Imagescited by 64
24 more
  1. 2023Open-Fusion: Real-time Open-Vocabulary 3D Mapping and Queryable Scene Representationcited by 54
  2. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 45
  3. 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 43
  4. 2017Multi-View Deep Learning for Consistent Semantic Mapping with RGB-D Camerascited by 28
  5. 2025OmniSAM: Omnidirectional Segment Anything Model for UDA in Panoramic Semantic Segmentationcited by 28
  6. 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 27
  7. 2020SCFusion: Real-time Incremental Scene Reconstruction with Semantic Completioncited by 25
  8. 2024ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattingscited by 20
  9. 2019What's in my Room? Object Recognition on Indoor Panoramic Imagescited by 16
  10. 2026PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagerycited by 13
  11. 2022Complementary Bi-directional Feature Compression for Indoor 360deg Semantic Segmentation with Self-distillationcited by 12
  12. 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Predictioncited by 11
  13. 2023Robust Fusion for Bayesian Semantic Mappingcited by 8
  14. 2025OneOcc: Semantic Occupancy Prediction for Legged Robots with a Single Panoramic Cameracited by 8
  15. 2023On the Overconfidence Problem in Semantic 3D Mappingcited by 7
  16. 2026Holo360D: A Large-Scale Real-World Dataset with Continuous Trajectories for Advancing Panoramic 3D Reconstruction and Beyondcited by 7
  17. 2026Monocular Open Vocabulary Occupancy Prediction for Indoor Scenescited by 5
  18. 2026Panoramic Multimodal Semantic Occupancy Prediction for Quadruped Robotscited by 5
  19. 2022PatchMatch-Stereo-Panorama, a fast dense reconstruction from 360deg video imagescited by 3
  20. 2026GEM-Occ: From Visual Geometry Evidence to Embodied Semantic Occupancy Memorycited by 3
  21. 2026Pano3DComposer: Feed-Forward Compositional 3D Scene Generation from Single Panoramic Imagecited by 2
  22. 2026O3N: Omnidirectional Open-Vocabulary Occupancy Prediction for Embodied Intelligent Roboticscited by 2
  23. 2026FreeOcc: Training-Free Embodied Open-Vocabulary Occupancy Predictioncited by 2
  24. 2026VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understandingcited by 1

Built on by

Not cited yet.