Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Robustness is a critical requirement for deploying autonomous driving systems in the real world. Existing robustness benchmarks for autonomous driving have made important progress in studying the effects of image-level corruptions, such as adverse weather or camera degradation, on perception modules and open-loop planning outputs. However, deployment can also involve system-level imperfections, such as inference latency and ego-state estimation errors, which remain less studied in closed-loop E2E-AD evaluation. These imperfections can accumulate through the feedback loop and destabilize control. In this work, we present Bench2Drive-Robust, to our knowledge the first device-centric robustness benchmark for closed-loop end-to-end autonomous driving under realistic deployment perturbations. We systematically evaluate deployment-oriented perturbations arising from three major sources: camera-stream failures (frame drop, partial observation), ego-state estimation errors (GPS noise, and speed or odometry errors), and compute-induced control delay (model inference delay). We evaluate representative end-to-end driving methods and analyze their robustness under different perturbation severities. Our results show that these deployment-related perturbations can substantially degrade closed-loop driving performance, revealing robustness challenges that are not fully captured by conventional image-level corruption evaluations. By establishing a closed-loop evaluation protocol and demonstrating the substantial impact of these deployment-oriented perturbations, Bench2Drive-Robust defines practical robustness problems for end-to-end autonomous driving and encourages further research on deployment-aware robust driving systems.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 70 of its 80 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
70 of 80 references.
Closest ancestors · 14
Same direction, newest first
- 2026Fail2Drive: Benchmarking Closed-Loop Driving Generalization9 Apr
- 2026Can Users Specify Driving Speed? Bench2Drive-Speed: Benchmark and Baselines for Desired-Speed Conditioned Autonomous Driving26 Mar
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2025Hydra-NeXt: Robust Closed-Loop Driving with Open-Loop Training15 Mar
- 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving5 Mar
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Driving10 Apr
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenes17 May
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline16 Jun
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
2 more
Other references · 56
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
38 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2019Learning by Cheatingcited by 361
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
- 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
- 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
- 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 47
- 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)cited by 45
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Drivingcited by 39
- 2024Is Your HD Map Constructor Reliable under Sensor Corruptions?cited by 28
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2021Evaluating Robustness over High Level Driving Instruction for Autonomous Driving
- 2026Real-World Perturbation Testing of Autonomous Driving Systems
- 2026Robustness Is a Function, Not a Number: A Factorized Comprehensive Study of OOD Robustness in Vision-Based Driving
- 2025Safety2Drive: Safety-Critical Scenario Benchmark for the Evaluation of Autonomous Driving
- 2026BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Driving
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios
- 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drive