mlsanityData to 7 Oct 2026

A Degradation-Tolerance Benchmark for Camera-Only End-to-End Driving

arXiv 2608.29005 ↗First posted 29 Aug 2026cs.ROcited by 0

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Camera-only end-to-end (E2E) driving models are nearing deployment, where the camera stream is degraded by blur, noise, low light, weather, frame loss, and memory faults. How much a policy tolerates before its driving breaks is unclear. Corruption-robustness benchmarks target detection or bird's-eye-view perception, not the planning output that drives the car. We present DriveDegrade, a benchmark for image-degradation tolerance in camera-only E2E driving. Sixteen corruption families at five severities are injected on the fly inside the image loader, one operator reaching fifteen policies, and we evaluate open-loop planning on nuScenes and NAVSIM plus a CARLA closed-loop anchor. First, mild degradation barely affects planning, and the families that break it have a clear threshold at mid severity. Second, fragility is corruption-dependent: blur, JPEG, and raindrop damage planning most, while weather and bit error are tolerated far into the range. Third, a flat curve is ambiguous, so we separate corruptions that degrade the image from those that remove it. A planner that reads its camera must lose accuracy when information is deleted, whatever it does under quality loss. On these two axes the planners separate sharply, quantifying the ego-status shortcut without mistaking indifference for robustness. A released vision-language-action planner is flat on both axes, and blinding all six of its cameras costs it only 11.5 percent.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 65 of its 78 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

65 of 78 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations18 May
  2. 2025iPad: Iterative Proposal-centric End-to-End Autonomous Driving21 May
  3. 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving7 Mar
  4. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
  5. 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
  6. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
  7. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
  8. 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving2 Aug
  9. 2023Hidden Biases of End-to-End Driving Models13 Jun
  10. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenes17 May
  11. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
  12. 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline16 Jun
2 more
  1. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
  2. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 51

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  5. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  6. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  7. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  8. 2019Natural Adversarial Examplescited by 1,401
  9. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  10. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  11. 2022Planning-oriented Autonomous Drivingcited by 1,068
  12. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
38 more
  1. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
  2. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  3. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  4. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  5. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  6. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  7. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
  8. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  9. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  10. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  11. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  12. 2018Learning to See in the Darkcited by 459
  13. 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 444
  14. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 401
  15. 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
  16. 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
  17. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  18. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  19. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  20. 2023Scene as Occupancycited by 208
  21. 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
  22. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  23. 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 161
  24. 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
  25. 20223D Common Corruptions and Data Augmentationcited by 120
  26. 2016Understanding How Image Quality Affects Deep Neural Networkscited by 118
  27. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
  28. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
  29. 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
  30. 2019Benchmarking the Robustness of Semantic Segmentation Modelscited by 111
  31. 2023A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinkingcited by 85
  32. 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 63
  33. 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applicationscited by 50
  34. 2023RoboBEV: Towards Robust Bird's Eye View Perception under Corruptionscited by 42
  35. 2025RAP: 3D Rasterization Augmented End-to-End Planningcited by 39
  36. 2019EDEN: Enabling Energy-Efficient, High-Performance Deep Neural Network Inference Using Approximate DRAMcited by 24
  37. 2024The RoboDrive Challenge: Drive Anytime Anywhere in Any Conditioncited by 23
  38. 2018On the Resilience of RTL NN Accelerators: Fault Characterization and Mitigationcited by 9

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Robustness Is a Function, Not a Number: A Factorized Comprehensive Study of OOD Robustness in Vision-Based Driving
  2. 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments
  3. 2026The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving
  4. 2026Driving on Memory
  5. 2026Fail2Drive: Benchmarking Closed-Loop Driving Generalization
  6. 2026A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving
  7. 2026Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Features
  8. 2025VR-Drive: Viewpoint-Robust End-to-End Driving with Feed-Forward 3D Gaussian Splatting