mlsanityData to 14 Oct 2026

FDR-Occ: Factorized Dense Routing for Full-Spectrum 3D Occupancy Prediction

arXiv 2607.03822 ↗First posted 4 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-based 3D occupancy prediction fundamentally relies on the 2D-to-3D view transformation. Current paradigms predominantly utilize explicit physical projection, which artificially restricts the routing matrix to strict, sparse camera rays. While computationally efficient, this imposes a severe Locality Bottleneck, preventing the network from constructing holistic contextual understanding and degrading sharply when camera extrinsics are unreliable or absent. To break this bottleneck, we abstract view transformation as unconstrained bipartite routing and propose Factorized Dense Routing (FDR). By approximating dense 2D-to-3D mixing through hierarchical tensor contractions, FDR guarantees a fully-global receptive field with tractable, sub-quadratic complexity. Crucially, the mandatory spatial contraction in dense routing exposes a fundamental Resolution-Context Trade-off. To address this, we introduce a Resolution-Context Decoupled Architecture. We factorize the 3D space into a global macroscopic topological anchor (via FDR) and precise local geometric planes (via explicit projection). This decoupling enables global semantic inference and exact surface localization to complement each other without mutual compromise. Extensive experiments demonstrate that our framework achieves state-of-the-art performance on the Occ3D-nuScenes and Occ3D-Waymo benchmarks. More notably, in an uncalibrated setting where physical extrinsics are withheld, our global routing internalizes the implicit multi-camera rig topology and exhibits substantially stronger structural robustness than physical-projection baselines under the same protocol.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 53 references that are in the map. First posted on arXiv 4 Jul 2026.

Builds on

49 of 53 references.

References · 49

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  4. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  5. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  6. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  7. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  8. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
  9. 2016Semantic Scene Completion from a Single Depth Imagecited by 472
  10. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  11. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  12. 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
37 more
  1. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  2. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  3. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  4. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  5. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  6. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 221
  7. 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
  8. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  9. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  10. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  11. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
  12. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
  13. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
  14. 2023FB-BEV: BEV Representation from Forward-Backward View Transformationscited by 98
  15. 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 96
  16. 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
  17. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 78
  18. 20213D Semantic Scene Completion: a Surveycited by 74
  19. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 67
  20. 2023Fully Sparse 3D Occupancy Predictioncited by 64
  21. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  22. 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
  23. 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
  24. 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
  25. 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
  26. 2024DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulationcited by 34
  27. 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 33
  28. 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
  29. 2024CVT-Occ: Cost Volume Temporal Fusion for 3D Occupancy Predictioncited by 24
  30. 2024ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictionscited by 20
  31. 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
  32. 2024ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decodercited by 17
  33. 2024Deep Height Decoupling for Precise Vision-based 3D Occupancy Predictioncited by 16
  34. 2024Panoptic-FlashOcc: An Efficient Baseline to Marry Semantic Occupancy with Panoptic via Instance Centercited by 14
  35. 2025Rethinking Temporal Fusion with a Unified Gradient Descent View for 3D Semantic Occupancy Predictioncited by 9
  36. 2025Semantic Causality-Aware Vision-Based 3D Occupancy Predictioncited by 8
  37. 2025SA-Occ: Satellite-Assisted 3D Occupancy Prediction in Real Worldcited by 3

Built on by

Not cited yet.