HyGE-Occ: Hybrid View-Transformation with 3D Gaussian and Edge Priors for 3D Panoptic Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
3D Panoptic Occupancy Prediction aims to reconstruct a dense volumetric scene map by predicting the semantic class and instance identity of every occupied region in 3D space. Achieving such fine-grained 3D understanding requires precise geometric reasoning and spatially consistent scene representation across complex environments. However, existing approaches often struggle to maintain precise geometry and capture the precise spatial range of 3D instances critical for robust panoptic separation. To overcome these limitations, we introduce HyGE-Occ, a novel framework that leverages a hybrid view-transformation branch with 3D Gaussian and edge priors to enhance both geometric consistency and boundary awareness in 3D panoptic occupancy prediction. HyGE-Occ employs a hybrid view-transformation branch that fuses a continuous Gaussian-based depth representation with a discretized depth-bin formulation, producing BEV features with improved geometric consistency and structural coherence. In parallel, we extract edge maps from BEV features and use them as auxiliary information to learn edge cues. In our extensive experiments on the Occ3D-nuScenes dataset, HyGE-Occ outperforms existing work, demonstrating superior 3D geometric reasoning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
43 of 55 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
31 more
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
- 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2023Fully Sparse 3D Occupancy Predictioncited by 61
- 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
- 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 39
- 2019Efficient Segmentation: Learning Downsampling Near Semantic Boundariescited by 33
- 2024DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Featurescited by 33
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
- 2025GaussianFlowOcc: Sparse and Weakly Supervised Occupancy Estimation using Gaussian Splatting and Temporal Flowcited by 24
- 2021Boundary-Aware Geometric Encoding for Semantic Segmentation of Point Cloudscited by 23
- 2021DRINet++: Efficient Voxel-as-point Point Cloud Segmentationcited by 23
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
- 2024ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictionscited by 19
- 2024Panoptic-FlashOcc: An Efficient Baseline to Marry Semantic Occupancy with Panoptic via Instance Centercited by 14
- 20253D Occupancy Prediction with Low-Resolution Queries via Prototype-aware View Transformationcited by 9
- 2025VoxelSplat: Dynamic Gaussian Splatting as an Effective Loss for Occupancy and Flow Predictioncited by 9
- 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mambacited by 8
- 2025BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysiscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026GaussianOcc3D: A Gaussian-Based Adaptive Multi-modal 3D Occupancy Prediction
- 2023RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation
- 2024Spatiotemporal Decoupling for Efficient Vision-Based Occupancy Forecasting
- 2025OccLE: Label-Efficient 3D Semantic Occupancy Prediction
- 2026Dr.Occ: Depth- and Region-Guided 3D Occupancy from Surround-View Cameras for Autonomous Driving
- 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Prediction
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting
- 2025LOC: A General Language-Guided Framework for Open-Set 3D Occupancy Prediction