A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Autonomous driving is a cornerstone technology for the future of intelligent transportation, where end-to-end learning has emerged as a transformative paradigm that directly maps multimodal sensory inputs to driving actions through unified differentiable models. While offering advantages, the effectiveness of end-to-end autonomous driving (E2E-AD) is ultimately determined by the quality of its training ecosystem. This paper provides a comprehensive review of training methods and ecosystem for E2E-AD. We introduce a Data-Strategy-Platform taxonomy that conceptualizes training as an interdependent system. The data layer defines what can be learned, the strategy layer governs how learning aligns with driving objectives, and the platform layer supports scalability and continuous evolution. Within this framework, we survey recent advances across data-centric pipelines, learning paradigms, and training infrastructures, and analyze their interplay in shaping model performance, robustness, and deployability. Finally, we reflect on current limitations and articulate a forward-looking vision that emphasizes a shift from data quantity to data value, from isolated optimization to foundation-driven generalization, and from static training to integrated training-testing loops, aiming toward robust, scalable, and trustworthy autonomous driving systems. We maintain a continuously updated repository tracking cutting-edge literature and works at hrefhttps://github.com/Jiaaqiliu/Awesome-Training-Ecosystem-for-E2E-ADOur Project Page.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 183 of its 264 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
183 of 264 references.
Closest ancestors · 9
Same direction, newest first
- 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarios30 Oct
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
- 2024Data-Centric Evolution in Autonomous Driving: A Comprehensive Survey of Big Data System, Data Mining, and Closed-Loop Technologies23 Jan
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Survey10 Jul
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles13 Dec
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 174
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2022Planning-oriented Autonomous Drivingcited by 1,068
38 more
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 621
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2018Behavioral Cloning from Observationcited by 482
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2021Implicit Behavioral Cloningcited by 442
- 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 400
- 2020Planning to Explore via Self-Supervised World Modelscited by 365
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2018Horovod: fast and easy distributed deep learning in TensorFlowcited by 275
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2024A Survey on Mixture of Experts in Large Language Modelscited by 233
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2020A2D2: Audi Autonomous Driving Datasetcited by 189
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
50 most cited of 174 All 174 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Post-Training in End-to-End Autonomous Driving
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review
- 2026The Era of End-to-End Autonomy: Transitioning from Rule-Based Driving to Large Driving Models
- 2026StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
- 2025Data Scaling Laws for End-to-End Autonomous Driving
- 2025DiffE2E: Rethinking End-to-End Driving with a Hybrid Action Diffusion and Supervised Policy