Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
End-to-end autonomous driving has evolved from camera-to-control regression toward planning-oriented systems that use structured representations, trajectory-level outputs, and increasingly realistic evaluation protocols. This survey reviews this transition across behavior cloning, conditional imitation learning, privileged distillation, BEV and vectorized planning, unified perception-prediction-planning architectures, world-model-based planners, and vision-language-action systems. We argue that the key distinction in modern end-to-end driving is not whether intermediate representations are used, but whether they are learned, supervised, and evaluated to support safe, feasible, and route-compliant planning. To organize the literature, we synthesize existing methods along four axes: input representation, planning output, supervision signal, and evaluation protocol. We further examine the benchmark shift from open-loop trajectory matching to closed-loop simulation, non-reactive real-log evaluation, long-tail testing, and human-preference-aware metrics. Our analysis highlights that architectural progress is difficult to interpret without benchmark-consistent evaluation, and that displacement-based open-loop metrics alone provide limited evidence for safe and human-aligned driving. We conclude with open challenges in uncertainty-aware planning, learner-expert mismatch, runtime safety assurance, language-action grounding, world-model validation, and reproducible benchmarking.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 12 of its 123 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
12 of 123 references.
Closest ancestors · 3
Same direction, newest first
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar
- 2025A Survey of World Models for Autonomous Driving20 Jan
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 9
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 391
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2026Driving on Registerscited by 38
- 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingcited by 34
- 2026Fail2Drive: Benchmarking Closed-Loop Driving Generalizationcited by 15
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
- 2024Exploring the Causality of End-to-End Autonomous Drivingcited by 7
- 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drivecited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023End-to-end Autonomous Driving: Challenges and Frontiers
- 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?
- 2026Post-Training in End-to-End Autonomous Driving
- 2025Perception in Plan: Coupled Perception and Planning for End-to-End Autonomous Driving
- 2025TrajDiff: End-to-end Autonomous Driving without Perception Annotation
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
- 2026Do Better Visual Representations Always Lead to Better End-to-End Autonomous Driving?