mlsanityData to 7 Oct 2026

HyGE-Occ: Hybrid View-Transformation with 3D Gaussian and Edge Priors for 3D Panoptic Occupancy Prediction

arXiv 2512.19871 ↗First posted 22 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D Panoptic Occupancy Prediction aims to reconstruct a dense volumetric scene map by predicting the semantic class and instance identity of every occupied region in 3D space. Achieving such fine-grained 3D understanding requires precise geometric reasoning and spatially consistent scene representation across complex environments. However, existing approaches often struggle to maintain precise geometry and capture the precise spatial range of 3D instances critical for robust panoptic separation. To overcome these limitations, we introduce HyGE-Occ, a novel framework that leverages a hybrid view-transformation branch with 3D Gaussian and edge priors to enhance both geometric consistency and boundary awareness in 3D panoptic occupancy prediction. HyGE-Occ employs a hybrid view-transformation branch that fuses a continuous Gaussian-based depth representation with a discretized depth-bin formulation, producing BEV features with improved geometric consistency and structural coherence. In parallel, we extract edge maps from BEV features and use them as auxiliary information to learn edge cues. In our extensive experiments on the Occ3D-nuScenes dataset, HyGE-Occ outperforms existing work, demonstrating superior 3D geometric reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

43 of 55 references.

References · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2023Segment Anythingcited by 8,158
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2024Depth Anything V2cited by 1,385
  8. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  9. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
  10. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  11. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  12. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
31 more
  1. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  2. 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
  3. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  4. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  5. 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
  6. 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
  7. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  8. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  9. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
  10. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
  11. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
  12. 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
  13. 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
  14. 2023Fully Sparse 3D Occupancy Predictioncited by 61
  15. 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
  16. 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
  17. 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
  18. 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 39
  19. 2019Efficient Segmentation: Learning Downsampling Near Semantic Boundariescited by 33
  20. 2024DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Featurescited by 33
  21. 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
  22. 2025GaussianFlowOcc: Sparse and Weakly Supervised Occupancy Estimation using Gaussian Splatting and Temporal Flowcited by 24
  23. 2021Boundary-Aware Geometric Encoding for Semantic Segmentation of Point Cloudscited by 23
  24. 2021DRINet++: Efficient Voxel-as-point Point Cloud Segmentationcited by 23
  25. 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
  26. 2024ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictionscited by 19
  27. 2024Panoptic-FlashOcc: An Efficient Baseline to Marry Semantic Occupancy with Panoptic via Instance Centercited by 14
  28. 20253D Occupancy Prediction with Low-Resolution Queries via Prototype-aware View Transformationcited by 9
  29. 2025VoxelSplat: Dynamic Gaussian Splatting as an Effective Loss for Occupancy and Flow Predictioncited by 9
  30. 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mambacited by 8
  31. 2025BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysiscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GaussianOcc3D: A Gaussian-Based Adaptive Multi-modal 3D Occupancy Prediction
  2. 2023RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation
  3. 2024Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting
  4. 2025OccLE: Label-Efficient 3D Semantic Occupancy Prediction
  5. 2026Dr.Occ: Depth- and Region-Guided 3D Occupancy from Surround-View Cameras for Autonomous Driving
  6. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Prediction
  7. 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting
  8. 2025LOC: A General Language-Guided Framework for Open-Set 3D Occupancy Prediction