Risk Map As Middleware: Towards Interpretable Cooperative End-to-end Autonomous Driving for Risk-Aware Planning
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
End-to-end paradigm has emerged as a promising approach to autonomous driving. However, existing single-agent end-to-end pipelines are often constrained by occlusion and limited perception range, resulting in hazardous driving. Furthermore, their black-box nature prevents the interpretability of the driving behavior, leading to an untrustworthiness system. To address these limitations, we introduce Risk Map as Middleware (RiskMM) and propose an interpretable cooperative end-to-end driving framework. The risk map learns directly from the driving data and provides an interpretable spatiotemporal representation of the scenario from the upstream perception and the interactions between the ego vehicle and the surrounding environment for downstream planning. RiskMM first constructs a multi-agent spatiotemporal representation with unified Transformer-based architecture, then derives risk-aware representations by modeling interactions among surrounding environments with attention. These representations are subsequently fed into a learning-based Model Predictive Control (MPC) module. The MPC planner inherently accommodates physical constraints and different vehicle types and can provide interpretation by aligning learned parameters with explicit MPC elements. Evaluations conducted on the real-world V2XPnP-Seq dataset confirm that RiskMM achieves superior and robust performance in risk-aware trajectory planning, significantly enhancing the interpretability of the cooperative end-to-end driving framework. The codebase will be released to facilitate future research in this field.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 31 of its 45 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
31 of 45 references.
Closest ancestors · 4
Same direction, newest first
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2024Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencoder2 Apr
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
Other references · 27
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015Fast R-CNNcited by 2,933
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
15 more
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2019F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Cloudscited by 171
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
- 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 103
- 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Modelscited by 47
- 2024End-to-End Autonomous Driving through V2X Cooperationcited by 42
- 2024Hint-AD: Holistically Aligned Interpretability in End-to-End Autonomous Drivingcited by 33
- 2023Flow-Based Feature Fusion for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 31
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
- 2024CMP: Cooperative Motion Prediction with Multi-Agent Communicationcited by 25
- 2025Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Drivingcited by 14
- 2025CooperRisk: A Driving Risk Quantification Pipeline with Multi-Agent Cooperative Perception and Predictioncited by 4
- 2023V2X-Lead: LiDAR-based End-to-End Autonomous Driving with Vehicle-to-Everything Communication Integrationcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Modelcited by 17
- 2025QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perceptioncited by 11
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemscited by 5
- 2026CooperDrive: Enhancing Driving Decisions Through Cooperative Perceptioncited by 0
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Drivingcited by 0
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Driving9 Sep 2026
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems11 May 2026
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Model21 Apr 2026
- 2026CooperDrive: Enhancing Driving Decisions Through Cooperative Perception15 Apr 2026
- 2025QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception3 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
- 2026Not All Agents Matter: From Global Attention Dilution to Risk-Prioritized Game Planning
- 2026Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Driving
- 2024RiskMap: A Unified Driving Context Representation for Autonomous Motion Planning in Urban Driving Environment
- 2022Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving
- 2026Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
- 2025Drive in Corridors: Enhancing the Safety of End-to-end Autonomous Driving via Corridor Learning and Planning