mlsanityData to 14 Oct 2026

Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Driving

arXiv 2609.21470 ↗First posted 18 Sep 2026cs.AIcited by 0

On the map: End-to-end autonomous driving → End-to-end system architecture also fits: Adversarial scenarios and safety testing

Abstract (arXiv)

Conventional end-to-end driving systems model the environment with sparse objects and lane elements. While efficient, this paradigm discards planning-critical information in crowded and occluded scenarios, particularly for unstructured obstacles, ambiguous free space, and complex interactions. We propose risk-aware occupancy, a dense BEV representation that explicitly fuses geometric occupancy, map-derived traffic constraints, and future dynamic-agent occupancy as complementary risk signals. Built upon this representation, we develop ROIDrive, an instance-centric end-to-end framework with a dedicated risk-aware occupancy branch. The predicted occupancy is tokenized via sliding-window sampling and injected into planning queries via cross-attention, while temporal query consistency mitigates unreliable flickering queries. We also contribute RiskOcc4D-nuScenes, a benchmark derived from nuScenes and Occ3D-nuScenes with four automated annotation pipelines for multi-dimensional risk supervision. Experiments on representative occupancy architectures verify the learnability and transferability of our representation. Integrated with GenAD, it reduces collision rates by 35.0% (UniAD metric) and 52.9% (ST-P3 metric), confirming the efficacy of the proposed representation modality.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 34 of its 46 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

34 of 46 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Driving on Registers8 Jan
  2. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul

Other references · 32

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  3. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  4. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  5. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  6. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  7. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  8. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  9. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  10. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  11. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  12. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
20 more
  1. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
  2. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 103
  3. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  4. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Drivingcited by 83
  5. 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
  6. 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 50
  7. 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
  8. 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 41
  9. 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
  10. 2023UniOcc: Unifying Vision-Centric 3D Occupancy Prediction with Geometric and Semantic Renderingcited by 26
  11. 2024ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decodercited by 17
  12. 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervisioncited by 17
  13. 2024Deep Height Decoupling for Precise Vision-based 3D Occupancy Predictioncited by 16
  14. 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Frameworkcited by 12
  15. 2024OccTransformer: Improving BEVFormer for 3D camera-only occupancy predictioncited by 6
  16. 2024MambaOcc: Visual State Space Model for BEV-based Occupancy Prediction with Local Adaptive Reorderingcited by 5
  17. 2024Risk Occupancy: A New and Efficient Paradigm through Vehicle-Road-Cloud Collaborationcited by 3
  18. 2025Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Modelscited by 3
  19. 2022How are Drivers' Stress Levels and Emotions Associated with the Driving Context? A Naturalistic Studycited by 2
  20. 2022The Impact of Surrounding Road Objects and Conditions on Drivers Abrupt Heart Rate Changescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving
  2. 2026Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving
  3. 2026Hope for the Best, Prepare for the Worst: Occlusion-Aware Contingency Planning for Autonomous Vehicles
  4. 2023Deep Occupancy-Predictive Representations for Autonomous Driving
  5. 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model
  6. 2025A Physics-informed End-to-End Occupancy Framework for Motion Planning of Autonomous Vehicles
  7. 2025Risk Map As Middleware: Towards Interpretable Cooperative End-to-end Autonomous Driving for Risk-Aware Planning
  8. 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception