mlsanityData to 7 Oct 2026

Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI

arXiv 2606.22971 ↗First posted 22 Jun 2026cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Occupancy prediction at voxel-level granularity is essential for safe robotic navigation and interaction in complex environments. Existing occupancy datasets, however, are predominantly designed for autonomous driving with vehicle-centric biases -- forward-facing cameras, far-field geometry, and static road priors -- limiting their applicability to embodied humanoid perception. We present Humanoid-OmniOcc, a large-scale panoramic stereo-based occupancy dataset tailored for humanoid robots. The dataset encompasses 15 diverse simulated indoor scenes and 5 real-world environments, yielding over 155K samples with broad scene and style diversity. Importantly, the dataset is designed around a Real2Sim2Real closed-loop paradigm: real sensor specifications drive physically accurate simulation, simulation produces large-scale annotated training data, and models trained in simulation are directly evaluated on real-world captures -- enabling iterative refinement of the sim-to-real pipeline. We further propose Humanoid Surround Stereo-guided Occupancy model (Humanoid-OmniOcc) that exploits robust depth priors for accurate 2D-to-3D lifting. Extensive experiments show that Humanoid-OmniOcc consistently outperforms monocular baselines and generalizes well to both unseen simulated test scenes and real-world environments, validating the effectiveness of the Real2Sim2Real design. Code and data will be available upon acceptance at https://d-robotics-ai-lab.github.io/humanoid-omniocc.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

43 of 48 references.

References · 43

  1. 2024Depth Anything V2cited by 1,385
  2. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  3. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  4. 2018Pyramid Stereo Matching Networkcited by 486
  5. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  6. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  7. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  8. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  9. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  10. 2019Group-wise Correlation Stereo Networkcited by 235
  11. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
  12. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
31 more
  1. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  2. 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
  3. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  4. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  5. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
  6. 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
  7. 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
  8. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
  9. 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
  10. 2018StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Predictioncited by 88
  11. 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
  12. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
  13. 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
  14. 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
  15. 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
  16. 2021Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume Excitationcited by 47
  17. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
  18. 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
  19. 2020FADNet: A Fast and Accurate Network for Disparity Estimationcited by 31
  20. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
  21. 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 28
  22. 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
  23. 2024Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matchingcited by 24
  24. 2024CVT-Occ: Cost Volume Temporal Fusion for 3D Occupancy Predictioncited by 23
  25. 2024Match Stereo Videos via Bidirectional Alignmentcited by 11
  26. 2024WildOcc: A Benchmark for Off-Road 3D Semantic Occupancy Predictioncited by 9
  27. 2025Advancing Off-Road Autonomous Driving: The Large-Scale ORAD-3D Dataset and Comprehensive Benchmarkscited by 8
  28. 2025Stereo Any Video: Temporally Consistent Stereo Matchingcited by 7
  29. 2022StereoVoxelNet: Real-Time Obstacle Detection Based on Occupancy Voxels from a Stereo Camera Using Deep Neural Networkscited by 6
  30. 2025Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robotscited by 5
  31. 2025Unleashing Semantic and Geometric Priors for 3D Scene Completioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.