mlsanityData to 13 Oct 2026

SGR-OCC: Evolving Monocular Priors for Embodied 3D Occupancy Prediction via Soft-Gating Lifting and Semantic-Adaptive Geometric Refinement

arXiv 2603.14076 ↗First posted 14 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D semantic occupancy prediction is a cornerstone for embodied AI, enabling agents to perceive dense scene geometry and semantics incrementally from monocular video streams. However, current online frameworks face two critical bottlenecks: the inherent depth ambiguity of monocular estimation that causes "feature bleeding" at object boundaries , and the "cold start" instability where uninitialized temporal fusion layers distort high-quality spatial priors during early training stages. In this paper, we propose SGR-OCC (Soft-Gating and Ray-refinement Occupancy), a unified framework driven by the philosophy of "Inheritance and Evolution". To perfectly inherit monocular spatial expertise, we introduce a Soft-Gating Feature Lifter that explicitly models depth uncertainty via a Gaussian gate to probabilistically suppress background noise. Furthermore, a Dynamic Ray-Constrained Anchor Refinement module simplifies complex 3D displacement searches into efficient 1D depth corrections along camera rays, ensuring sub-voxel adherence to physical surfaces. To ensure stable evolution toward temporal consistency, we employ a Two-Phase Progressive Training Strategy equipped with identity-initialized fusion, effectively resolving the cold start problem and shielding spatial priors from noisy early gradients. Extensive experiments on the EmbodiedOcc-ScanNet and Occ-ScanNet benchmarks demonstrate that SGR-OCC achieves state-of-the-art performance. In local prediction tasks, SGR-OCC achieves a completion IoU of 58.55% and a semantic mIoU of 49.89%, surpassing the previous best method, EmbodiedOcc++, by 3.65% and 3.69% respectively. In challenging embodied prediction tasks, our model reaches 55.72% SC-IoU and 46.22% mIoU. Qualitative results further confirm our model's superior capability in preserving structural integrity and boundary sharpness in complex indoor environments.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 53 of its 57 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

53 of 57 references.

References · 53

  1. 2025Qwen3 Technical Reportcited by 8,510
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
  3. 2016Layer Normalizationcited by 5,624
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,601
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,096
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,068
  7. 2025Qwen3-VL Technical Reportcited by 2,663
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
  9. 2024Depth Anything V2cited by 1,399
  10. 2019Habitat: A Platform for Embodied AI Researchcited by 1,169
  11. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  12. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 658
38 more
  1. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 613
  2. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 465
  3. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 406
  4. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  5. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 359
  6. 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
  7. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 314
  8. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 312
  9. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 308
  10. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 290
  11. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 283
  12. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 270
  13. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  14. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 156
  15. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
  16. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
  17. 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
  18. 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
  19. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 102
  20. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  21. 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
  22. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 66
  23. 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 53
  24. 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 52
  25. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 44
  26. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 30
  27. 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 27
  28. 2024Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localizationcited by 16
  29. 2023NTO3D: Neural Target Object 3D Reconstruction with Segment Anythingcited by 14
  30. 2024EMD: Explicit Motion Modeling for High-Quality Street Gaussian Splattingcited by 13
  31. 2024HybridOcc: NeRF Enhanced Transformer-based Multi-Camera 3D Occupancy Predictioncited by 12
  32. 2024GraphAvatar: Compact Head Avatars with GNN-Generated 3D Gaussianscited by 11
  33. 2024OccRWKV: Rethinking Efficient 3D Semantic Occupancy Prediction with Linear Complexitycited by 9
  34. 2025Rethinking Temporal Fusion with a Unified Gradient Descent View for 3D Semantic Occupancy Predictioncited by 9
  35. 2025SliceOcc: Indoor 3D Semantic Occupancy Prediction with Vertical Slice Representationcited by 8
  36. 2021Navigation-Oriented Scene Understanding for Robotic Autonomy: Learning to Segment Driveability in Egocentric Imagescited by 6
  37. 2025IDInit: A Universal and Stable Initialization Method for Neural Network Trainingcited by 5
  38. 2026GaussianOcc3D: A Gaussian-Based Adaptive Multi-modal 3D Occupancy Predictioncited by 5

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.