mlsanityData to 7 Oct 2026

Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations

arXiv 2605.18059 ↗First posted 18 May 2026cs.ROcited by 3

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Robustness is a critical requirement for deploying autonomous driving systems in the real world. Existing robustness benchmarks for autonomous driving have made important progress in studying the effects of image-level corruptions, such as adverse weather or camera degradation, on perception modules and open-loop planning outputs. However, deployment can also involve system-level imperfections, such as inference latency and ego-state estimation errors, which remain less studied in closed-loop E2E-AD evaluation. These imperfections can accumulate through the feedback loop and destabilize control. In this work, we present Bench2Drive-Robust, to our knowledge the first device-centric robustness benchmark for closed-loop end-to-end autonomous driving under realistic deployment perturbations. We systematically evaluate deployment-oriented perturbations arising from three major sources: camera-stream failures (frame drop, partial observation), ego-state estimation errors (GPS noise, and speed or odometry errors), and compute-induced control delay (model inference delay). We evaluate representative end-to-end driving methods and analyze their robustness under different perturbation severities. Our results show that these deployment-related perturbations can substantially degrade closed-loop driving performance, revealing robustness challenges that are not fully captured by conventional image-level corruption evaluations. By establishing a closed-loop evaluation protocol and demonstrating the substantial impact of these deployment-oriented perturbations, Bench2Drive-Robust defines practical robustness problems for end-to-end autonomous driving and encourages further research on deployment-aware robust driving systems.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 70 of its 80 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

70 of 80 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Fail2Drive: Benchmarking Closed-Loop Driving Generalization9 Apr
  2. 2026Can Users Specify Driving Speed? Bench2Drive-Speed: Benchmark and Baselines for Desired-Speed Conditioned Autonomous Driving26 Mar
  3. 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
  4. 2025Hydra-NeXt: Robust Closed-Loop Driving with Open-Loop Training15 Mar
  5. 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving5 Mar
  6. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
  7. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
  8. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
  9. 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Driving10 Apr
  10. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenes17 May
  11. 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline16 Jun
  12. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
2 more
  1. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
  2. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Driving19 Apr

Other references · 56

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  2. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  3. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  5. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  6. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  7. 2022Planning-oriented Autonomous Drivingcited by 1,068
  8. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  9. 2016End to End Learning for Self-Driving Carscited by 1,000
  10. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  11. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  12. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
38 more
  1. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  2. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  3. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  4. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  5. 2017End-to-end Driving via Conditional Imitation Learningcited by 479
  6. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
  7. 2019Learning by Cheatingcited by 361
  8. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
  9. 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
  10. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  11. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  12. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  13. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
  14. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  15. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
  16. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  17. 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
  18. 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
  19. 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
  20. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
  21. 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
  22. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
  23. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  24. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
  25. 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
  26. 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
  27. 2023Dolphins: Multimodal Language Model for Drivingcited by 124
  28. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
  29. 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
  30. 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
  31. 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
  32. 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
  33. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
  34. 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
  35. 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 47
  36. 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)cited by 45
  37. 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Drivingcited by 39
  38. 2024Is Your HD Map Constructor Reliable under Sensor Corruptions?cited by 28

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2021Evaluating Robustness over High Level Driving Instruction for Autonomous Driving
  2. 2026Real-World Perturbation Testing of Autonomous Driving Systems
  3. 2026Robustness Is a Function, Not a Number: A Factorized Comprehensive Study of OOD Robustness in Vision-Based Driving
  4. 2025Safety2Drive: Safety-Critical Scenario Benchmark for the Evaluation of Autonomous Driving
  5. 2026BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Driving
  6. 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model
  7. 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios
  8. 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drive