mlsanityData to 14 Oct 2026

Risk Map As Middleware: Towards Interpretable Cooperative End-to-end Autonomous Driving for Risk-Aware Planning

arXiv 2508.07686 ↗First posted 11 Aug 2025cs.ROcited by 5

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

End-to-end paradigm has emerged as a promising approach to autonomous driving. However, existing single-agent end-to-end pipelines are often constrained by occlusion and limited perception range, resulting in hazardous driving. Furthermore, their black-box nature prevents the interpretability of the driving behavior, leading to an untrustworthiness system. To address these limitations, we introduce Risk Map as Middleware (RiskMM) and propose an interpretable cooperative end-to-end driving framework. The risk map learns directly from the driving data and provides an interpretable spatiotemporal representation of the scenario from the upstream perception and the interactions between the ego vehicle and the surrounding environment for downstream planning. RiskMM first constructs a multi-agent spatiotemporal representation with unified Transformer-based architecture, then derives risk-aware representations by modeling interactions among surrounding environments with attention. These representations are subsequently fed into a learning-based Model Predictive Control (MPC) module. The MPC planner inherently accommodates physical constraints and different vehicle types and can provide interpretation by aligning learned parameters with explicit MPC elements. Evaluations conducted on the real-world V2XPnP-Seq dataset confirm that RiskMM achieves superior and robust performance in risk-aware trajectory planning, significantly enhancing the interpretability of the cooperative end-to-end driving framework. The codebase will be released to facilitate future research in this field.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 31 of its 45 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

31 of 45 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
  2. 2024Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencoder2 Apr
  3. 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun
  4. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul

Other references · 27

  1. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  2. 2015Fast R-CNNcited by 2,933
  3. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  4. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  5. 2022Planning-oriented Autonomous Drivingcited by 1,087
  6. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  7. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
  8. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  9. 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
  10. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
  11. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
  12. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
15 more
  1. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  2. 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
  3. 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
  4. 2019F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Cloudscited by 171
  5. 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
  6. 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 103
  7. 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Modelscited by 47
  8. 2024End-to-End Autonomous Driving through V2X Cooperationcited by 42
  9. 2024Hint-AD: Holistically Aligned Interpretability in End-to-End Autonomous Drivingcited by 33
  10. 2023Flow-Based Feature Fusion for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 31
  11. 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
  12. 2024CMP: Cooperative Motion Prediction with Multi-Agent Communicationcited by 25
  13. 2025Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Drivingcited by 14
  14. 2025CooperRisk: A Driving Risk Quantification Pipeline with Multi-Agent Cooperative Perception and Predictioncited by 4
  15. 2023V2X-Lead: LiDAR-based End-to-End Autonomous Driving with Vehicle-to-Everything Communication Integrationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
  2. 2026Not All Agents Matter: From Global Attention Dilution to Risk-Prioritized Game Planning
  3. 2026Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Driving
  4. 2024RiskMap: A Unified Driving Context Representation for Autonomous Motion Planning in Urban Driving Environment
  5. 2022Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving
  6. 2026Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving
  7. 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
  8. 2025Drive in Corridors: Enhancing the Safety of End-to-end Autonomous Driving via Corridor Learning and Planning