mlsanityData to 14 Oct 2026

SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Rendering

arXiv 2511.17361 ↗First posted 21 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervision for semantic occupancy estimation is appealing as it removes the labour-intensive manual annotation, thus allowing one to scale to larger autonomous driving datasets. Superquadrics offer an expressive shape family very suitable for this task, yet their deployment in a self-supervised setting has been hindered by the lack of efficient rendering methods to bridge the 3D scene representation with 2D training pseudo-labels. To address this, we introduce SuperQuadricOcc, the first self-supervised occupancy model to leverage superquadrics for scene representation. To overcome the rendering limitation, we propose a real-time volume renderer that preserves the fidelity of the superquadric shape during rendering. It relies on spatial superquadric-voxel indexing, restricting each ray sample to query only nearby superquadrics, thereby greatly reducing memory usage and computational cost. Using drastically fewer primitives than prior Gaussian-based methods, SuperQuadricOcc achieves state-of-the-art RayIoU on Occ3D-nuScenes with real-time inference and a substantially reduced memory footprint, while also outperforming Gaussian-based baselines on downstream occupancy forecasting and trajectory estimation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 71 of its 91 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

71 of 91 references.

References · 71

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  8. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  9. 2022Planning-oriented Autonomous Drivingcited by 1,087
  10. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  11. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  12. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
38 more
  1. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  2. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  3. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  4. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  5. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  6. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  7. 2021Neural RGB-D Surface Reconstructioncited by 313
  8. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  9. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  10. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  11. 2024A Survey on 3D Gaussian Splattingcited by 224
  12. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 221
  13. 2023Scene as Occupancycited by 209
  14. 2023A Simple Framework for Open-Vocabulary Segmentation and Detectioncited by 198
  15. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  16. 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
  17. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  18. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
  19. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  20. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  21. 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 123
  22. 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 96
  23. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  24. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
  25. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Drivingcited by 83
  26. 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
  27. 2022NerfAcc: A General NeRF Acceleration Toolboxcited by 74
  28. 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
  29. 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
  30. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 67
  31. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Modelcited by 61
  32. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  33. 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 52
  34. 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
  35. 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
  36. 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
  37. 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
  38. 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 44

50 most cited of 71 All 71 (JSON)

Built on by

Not cited yet.