GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors
Not on the map. Why?
Abstract (arXiv)
Accurate 3D scene understanding is fundamental to embodied intelligence and autonomous driving, where 3D occupancy provides a unified representation of objects, structures, and free space. However, recovering such a complete volumetric representation from visual observations remains challenging, particularly in occluded and unobserved regions. Visual geometry priors offer strong and generalizable geometric cues for addressing this challenge, but their outputs are inherently surface-centric, whereas occupancy prediction requires reasoning about volumetric interiors and free space. To bridge this gap, we introduce GPOcc, which transforms visual geometry priors into occupancy-aware sparse Gaussian representations for efficient and expressive volumetric scene modeling. Building on GPOcc, GPOcc++ models multi-view observations and temporal sequences within a unified framework, allowing spatial and temporal evidence to be handled through the same representation. We further extend GPOcc++ from indoor scenes to outdoor occupancy prediction. Extensive experiments on both indoor and outdoor benchmarks demonstrate consistently strong performance across both multi-view and temporal settings, together with favorable efficiency and generalization. Code will be released at https://github.com/JuIvyy/GPOcc.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
56 of 68 references.
References · 56
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
38 more
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 20243D Reconstruction with Spatial Memorycited by 277
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 90
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 87
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
- 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Drivingcited by 83
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
- 2020Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Datacited by 74
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 45
- 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
- 2024Occupancy as Set of Pointscited by 38
- 2023Learning Occupancy for Monocular 3D Object Detectioncited by 36
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 31
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 30
- 2024OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Drivingcited by 27
- 2025EmbodiedOcc++: Boosting Embodied 3D Occupancy Prediction with Plane Regularization and Uncertainty Samplercited by 27
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Predictioncited by 20
- 2024Hybrid-Prediction Integrated Planning for Autonomous Drivingcited by 18
- 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervisioncited by 17
- 2023RayMVSNet++: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereocited by 15
- 2025RoboOcc: Enhancing the Geometric and Semantic Scene Understanding for Robotscited by 15
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.