mlsanityData to 14 Oct 2026

GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors

arXiv 2607.13481 ↗First posted 15 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate 3D scene understanding is fundamental to embodied intelligence and autonomous driving, where 3D occupancy provides a unified representation of objects, structures, and free space. However, recovering such a complete volumetric representation from visual observations remains challenging, particularly in occluded and unobserved regions. Visual geometry priors offer strong and generalizable geometric cues for addressing this challenge, but their outputs are inherently surface-centric, whereas occupancy prediction requires reasoning about volumetric interiors and free space. To bridge this gap, we introduce GPOcc, which transforms visual geometry priors into occupancy-aware sparse Gaussian representations for efficient and expressive volumetric scene modeling. Building on GPOcc, GPOcc++ models multi-view observations and temporal sequences within a unified framework, allowing spatial and temporal evidence to be handled through the same representation. We further extend GPOcc++ from indoor scenes to outdoor occupancy prediction. Extensive experiments on both indoor and outdoor benchmarks demonstrate consistently strong performance across both multi-view and temporal settings, together with favorable efficiency and generalization. Code will be released at https://github.com/JuIvyy/GPOcc.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

56 of 68 references.

References · 56

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  2. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  4. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  5. 2024Depth Anything V2cited by 1,422
  6. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  7. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  8. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  9. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
  10. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  11. 2016Semantic Scene Completion from a Single Depth Imagecited by 472
  12. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
38 more
  1. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  2. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  3. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  4. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  5. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  6. 20243D Reconstruction with Spatial Memorycited by 277
  7. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  8. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  9. 2025Streaming 4D Visual Geometry Transformercited by 161
  10. 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
  11. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  12. 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
  13. 2022Vision-Centric BEV Perception: A Surveycited by 126
  14. 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
  15. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  16. 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 90
  17. 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 87
  18. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
  19. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Drivingcited by 83
  20. 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
  21. 2020Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Datacited by 74
  22. 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
  23. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  24. 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
  25. 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
  26. 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 45
  27. 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
  28. 2024Occupancy as Set of Pointscited by 38
  29. 2023Learning Occupancy for Monocular 3D Object Detectioncited by 36
  30. 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 31
  31. 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 30
  32. 2024OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Drivingcited by 27
  33. 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 27
  34. 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Predictioncited by 20
  35. 2024Hybrid-Prediction Integrated Planning for Autonomous Drivingcited by 18
  36. 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervisioncited by 17
  37. 2023RayMVSNet++: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereocited by 15
  38. 2025RoboOcc: Enhancing the Geometric and Semantic Scene Understanding for Robotscited by 15

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.