mlsanityData to 7 Oct 2026

OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Prediction

arXiv 2608.08696 ↗First posted 9 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D occupancy prediction is fundamental to scene understanding, yet existing 3D semantic occupancy methods are typically specialized to fixed scene types and occupancy protocols. We introduce Cross-Scene 3D Semantic Occupancy Prediction, a new task setting which requires a single model to handle heterogeneous indoor and outdoor scenes with varying cameras, spatial ranges, voxel specifications, and semantic taxonomies. This setting poses a fundamental challenge: achieving metric-consistent yet scene-adaptive image-to-3D lifting across varying camera configurations and scene scales. To address this challenge, we propose OccAnyScene, a pixel-frustum-centered Gaussian framework built upon a pretrained depth foundation model. Specifically, the framework employs Pixel-Aligned Frustum Feature Aggregation to construct a camera-aware frustum query for each feature pixel, and Frustum-Parameterized Gaussian Construction to decode each query into multiple Gaussians whose positions and sizes are constrained by the predicted pixel depth and corresponding frustum geometry. OccAnyScene sets new state-of-the-art results, achieving 59.92% mIoU on the indoor Occ-ScanNet and 23.06% mIoU on the outdoor SurroundOcc-nuScenes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 38 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

36 of 38 references.

References · 36

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  4. 2024Depth Anything V2cited by 1,385
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  6. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  7. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  8. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  9. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  10. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  11. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  12. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
24 more
  1. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  2. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
  3. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
  4. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  5. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
  6. 2022Vision-Centric BEV Perception: A Surveycited by 126
  7. 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 113
  8. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
  9. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
  10. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 66
  11. 2023Fully Sparse 3D Occupancy Predictioncited by 61
  12. 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
  13. 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
  14. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
  15. 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
  16. 2025RoboFactory: Exploring Embodied Agent Collaboration with Compositional Constraintscited by 31
  17. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
  18. 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 26
  19. 2025RoboOcc: Enhancing the Geometric and Semantic Scene Understanding for Robotscited by 15
  20. 2026Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Predictioncited by 9
  21. 2025SplatSSC: Decoupled Depth-Guided Gaussian Splatting for Semantic Scene Completioncited by 7
  22. 2026OccAny: Generalized Unconstrained Urban 3D Occupancycited by 6
  23. 2026VG3S: Visual Geometry Grounded Gaussian Splatting for Semantic Occupancy Predictioncited by 4
  24. 2026DLWM: Dual Latent World Models enable Holistic Gaussian-centric Pre-training in Autonomous Drivingcited by 2

Built on by

Not cited yet.