mlsanityData to 7 Oct 2026

The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving

arXiv 2602.12563 ↗First posted 13 Feb 2026cs.CVcited by 0

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Despite rapid progress, autonomous driving algorithms remain notoriously fragile under Out-of-Distribution (OOD) conditions. We identify a critical decoupling failure in current research: the lack of distinction between appearance-based shifts, such as weather and lighting, and structural scene changes. This leaves a fundamental question unanswered: Is the planner failing because of complex road geometry, or simply because it is raining? To resolve this, we establish navdream, a high-fidelity robustness benchmark leveraging generative pixel-aligned style transfer. By creating a visual stress test with negligible geometric deviation, we isolate the impact of appearance on driving performance. Our evaluation reveals that existing planning algorithms often show significant degradation under OOD appearance conditions, even when the underlying scene structure remains consistent. To bridge this gap, we propose a universal perception interface leveraging a frozen visual foundation model (DINOv3). By extracting appearance-invariant features as a stable interface for the planner, we achieve exceptional zero-shot generalization across diverse planning paradigms, including regression-based, diffusion-based, and scoring-based models. Our plug-and-play solution maintains consistent performance across extreme appearance shifts without requiring further fine-tuning. The benchmark and code will be made available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 39 of its 48 references that are in the map. First posted on arXiv 13 Feb 2026.

Builds on

39 of 48 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026See Less, Drive Better: Generalizable End-to-End Autonomous Driving via Foundation Models Stochastic Patch Selection15 Jan
  2. 2026FROST-Drive: Scalable and Efficient End-to-End Driving with a Frozen Vision Encoder6 Jan
  3. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
  4. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillation17 Mar
  5. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
  6. 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous driving7 Mar
  7. 2023Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Models26 Oct
  8. 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun
  9. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May

Other references · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  7. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  8. 2024Depth Anything V2cited by 1,385
  9. 2025DINOv3cited by 1,297
  10. 2022Planning-oriented Autonomous Drivingcited by 1,068
  11. 2025SAM 3: Segment Anything with Conceptscited by 835
  12. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
18 more
  1. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  2. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  3. 2018Learning to Drive in a Daycited by 266
  4. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  5. 2019An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detectioncited by 163
  6. 2025Pseudo-Simulation for Autonomous Drivingcited by 141
  7. 2024VLP: Vision Language Planning for Autonomous Drivingcited by 125
  8. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
  9. 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
  10. 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 63
  11. 2024Driving Everywhere with Large Language Model Policy Adaptationcited by 53
  12. 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 52
  13. 2019Simulation-based reinforcement learning for real-world autonomous drivingcited by 51
  14. 2021Domain Adaptation In Reinforcement Learning Via Latent Unified State Representationcited by 33
  15. 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorercited by 16
  16. 2021What data do we need for training an AV motion planner?cited by 15
  17. 2024ViPOcc: Leveraging Visual Priors from Vision Foundation Models for Single-View 3D Occupancy Predictioncited by 8
  18. 2021A Versatile and Efficient Reinforcement Learning Framework for Autonomous Drivingcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Robustness Is a Function, Not a Number: A Factorized Comprehensive Study of OOD Robustness in Vision-Based Driving
  2. 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective
  3. 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?
  4. 2026A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving
  5. 2026Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Driving
  6. 2026ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving
  7. 2025SUPER-AD: Semantic Uncertainty-aware Planning for End-to-End Robust Autonomous Driving
  8. 2026Driving with DINO: Vision Foundation Features as a Unified Bridge for Sim-to-Real Generation in Autonomous Driving