A Survey of End-to-End Driving: Architectures and Training Methods
Not on the map. Why?
Cited by 78 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take a deeper look on the so called end-to-end approaches for autonomous driving, where the entire driving pipeline is replaced with a single neural network. We review the learning methods, input and output modalities, network architectures and evaluation schemes in end-to-end driving literature. Interpretability and safety are discussed separately, as they remain challenging for this approach. Beyond providing a comprehensive overview of existing methods, we conclude the review with an architecture that combines the most promising elements of the end-to-end autonomous driving systems.
Key facts. Cited by 123 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 21; 2022: 7; 2023: 31; 2024: 23; 2025: 25; 2026: 15.
123 papers.
Sort:
By area:
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Modelscited by 158
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
- 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 124
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 112
38 more
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Surveycited by 101
- 2023ADAPT: Action-aware Driving Caption Transformercited by 78
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 40
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Drivingcited by 31
- 2021VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigationcited by 27
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Drivingcited by 24
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2025Flow Matching-Based Autonomous Driving Planning with Advanced Interactive Behavior Modelingcited by 22
- 2022End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agentcited by 21
- 2021Adversarial Driving: Attacking End-to-End Autonomous Drivingcited by 19
- 2021What data do we need for training an AV motion planner?cited by 15
- 2024FRENETIX: A High-Performance and Modular Motion Planning Framework for Autonomous Drivingcited by 14
- 2024Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMscited by 13
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learningcited by 13
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2020Robust Behavioral Cloning for Autonomous Vehicles using End-to-End Imitation Learningcited by 11
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2024On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Drivingcited by 10
- 2021Behavioral Research and Practical Models of Drivers' Attentioncited by 9
- 2021Self-Supervised Action-Space Prediction for Automated Drivingcited by 9
- 2025DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modelingcited by 9
- 2025DiffE2E: Rethinking End-to-End Driving with a Hybrid Action Diffusion and Supervised Policycited by 9
- 2021SAGE: A Split-Architecture Methodology for Efficient End-to-End Autonomous Vehicle Controlcited by 8
- 2021Self-supervised Point Cloud Representation Learning via Separating Mixed Shapescited by 8
- 2023Scaling Vision-based End-to-End Driving with Multi-View Attention Learningcited by 8
- 2022LiDAR-as-Camera for End-to-End Drivingcited by 7
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Reviewcited by 7
- 2024NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learningcited by 7
- 2024Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Drivingcited by 7
- 2021Navigation-Oriented Scene Understanding for Robotic Autonomy: Learning to Segment Driveability in Egocentric Imagescited by 6
- 2024Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencodercited by 6
50 most cited of 123 All 123 (JSON)
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems1 Oct 2026
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing3 Aug 2026
- 2026BucketKD: A Safety-Aware Bucket-Based Knowledge Distillation Framework for End-to-End Motion Planning12 Jul 2026
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving30 Jun 2026
- 2026A Stitch in Time Saves Nine: Preserving Policy Compatibility Under Perception Updates in End-to-End Autonomous Driving19 Jun 2026
- 2026An Exposure-Time-Aligned Primary-Path Architecture for Autonomous-Driving ECUs9 Jun 2026
- 2026MTA-RL: Robust Urban Driving via Multi-modal Transformer-based 3D Affordances and Reinforcement Learning11 May 2026
- 2026UniAda: Universal Adaptive Multi-objective Adversarial Attack for End-to-End Autonomous Driving Systems25 Apr 2026
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning14 Apr 2026
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving13 Apr 2026
- 2026COIN: Collaborative Interaction-Aware Multi-Agent Reinforcement Learning for Self-Driving Systems26 Mar 2026
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
38 more
- 2026Beyond Scalar Rewards: Distributional Reinforcement Learning with Preordered Objectives for Safe and Reliable Autonomous Driving6 Mar 2026
- 2026Kill it with FIRE: On Leveraging Latent Space Directions for Runtime Backdoor Mitigation in Deep Neural Networks11 Feb 2026
- 2026Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving29 Jan 2026
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025Spatial Retrieval Augmented Autonomous Driving7 Dec 2025
- 2025DSBench: A Comprehensive Benchmark for Evaluating External and In-Cabin Risks18 Nov 2025
- 2025Embodied Cognition Augmented End2End Autonomous Driving3 Nov 2025
- 2025Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challenges31 Oct 2025
- 2025Flow Matching-Based Autonomous Driving Planning with Advanced Interactive Behavior Modeling13 Oct 2025
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving24 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025Interpretable Decision-Making for End-to-End Autonomous Driving26 Aug 2025
- 2025FedS2R: One-Shot Federated Domain Generalization for Synthetic-to-Real Semantic Segmentation in Autonomous Driving26 Jul 2025
- 2025A Hierarchical Test Platform for Vision Language Model (VLM)-Integrated Real-World Autonomous Driving17 Jun 2025
- 2025Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks8 Jun 2025
- 2025RealDrive: Retrieval-Augmented Driving with Diffusion Models30 May 2025
- 2025DiffE2E: Rethinking End-to-End Driving with a Hybrid Action Diffusion and Supervised Policy26 May 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025aUToPath: Unified Planning and Control for Autonomous Vehicles in Urban Environments Using Hybrid Lattice and Free-Space Search14 May 2025
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attention15 Apr 2025
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr 2025
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios2 Apr 2025
- 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective31 Mar 2025
- 2025DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modeling19 Mar 2025
- 2025Active Learning from Scene Embeddings for End-to-End Autonomous Driving14 Mar 2025
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving27 Feb 2025
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning3 Feb 2025
- 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidance26 Jan 2025
- 2024Towards Selection and Transition Between Behavior-Based Neural Networks for Automated Driving21 Dec 2024
- 2024End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning25 Nov 2024
- 2024Optical Flow Matters: an Empirical Comparative Study on Fusing Monocular Extracted Modalities for Better Steering18 Sep 2024
- 2024Integrating End-to-End and Modular Driving Approaches for Online Corner Case Detection in Autonomous Driving2 Sep 2024
- 2024Enhancing End-to-End Autonomous Driving Systems Through Synchronized Human Behavior Data20 Aug 2024
- 2024DINO Pre-training for Vision-based End-to-end Autonomous Driving15 Jul 2024
- 2024Divide, Ensemble and Conquer: The Last Mile on Unsupervised Domain Adaptation for Semantic Segmentation27 Jun 2024
- 2024MaskFuser: Masked Fusion of Joint Multi-Modal Tokenization for End-to-End Autonomous Driving13 May 2024
- 2024Unified End-to-End V2X Cooperative Autonomous Driving7 May 2024
- 2024Enhance Planning with Physics-informed Safety Controller for End-to-end Autonomous Driving1 May 2024
50 newest of 123 All 123 (JSON)
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 112
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Surveycited by 101
- 2023ADAPT: Action-aware Driving Caption Transformercited by 78
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Drivingcited by 31
12 most cited of 68 All 68 (JSON)
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems1 Oct 2026
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing3 Aug 2026
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving30 Jun 2026
- 2026A Stitch in Time Saves Nine: Preserving Policy Compatibility Under Perception Updates in End-to-End Autonomous Driving19 Jun 2026
- 2026An Exposure-Time-Aligned Primary-Path Architecture for Autonomous-Driving ECUs9 Jun 2026
- 2026MTA-RL: Robust Urban Driving via Multi-modal Transformer-based 3D Affordances and Reinforcement Learning11 May 2026
- 2026UniAda: Universal Adaptive Multi-objective Adversarial Attack for End-to-End Autonomous Driving Systems25 Apr 2026
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving13 Apr 2026
- 2026COIN: Collaborative Interaction-Aware Multi-Agent Reinforcement Learning for Self-Driving Systems26 Mar 2026
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
- 2026Beyond Scalar Rewards: Distributional Reinforcement Learning with Preordered Objectives for Safe and Reliable Autonomous Driving6 Mar 2026
- 2026Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving29 Jan 2026
12 newest of 68 All 68 (JSON)
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 124
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Drivingcited by 24
- 2025DSBench: A Comprehensive Benchmark for Evaluating External and In-Cabin Riskscited by 3
- 2025DSBench: A Comprehensive Benchmark for Evaluating External and In-Cabin Risks18 Nov 2025
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving24 Sep 2025
- 2023DriveLM: Driving with Graph Visual Question Answering21 Dec 2023
- 2023Dolphins: Multimodal Language Model for Driving1 Dec 2023
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlook22 Oct 2023
- 2025RealDrive: Retrieval-Augmented Driving with Diffusion Models30 May 2025
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 40
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2021What data do we need for training an AV motion planner?cited by 15
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2021Behavioral Research and Practical Models of Drivers' Attentioncited by 9
- 2021Self-Supervised Action-Space Prediction for Automated Drivingcited by 9
- 2025DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modelingcited by 9
- 2021SAGE: A Split-Architecture Methodology for Efficient End-to-End Autonomous Vehicle Controlcited by 8
12 most cited of 41 All 41 (JSON)
- 2026BucketKD: A Safety-Aware Bucket-Based Knowledge Distillation Framework for End-to-End Motion Planning12 Jul 2026
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning14 Apr 2026
- 2026Kill it with FIRE: On Leveraging Latent Space Directions for Runtime Backdoor Mitigation in Deep Neural Networks11 Feb 2026
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025FedS2R: One-Shot Federated Domain Generalization for Synthetic-to-Real Semantic Segmentation in Autonomous Driving26 Jul 2025
- 2025Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks8 Jun 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attention15 Apr 2025
- 2025DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modeling19 Mar 2025
- 2024Optical Flow Matters: an Empirical Comparative Study on Fusing Monocular Extracted Modalities for Better Steering18 Sep 2024
- 2024Divide, Ensemble and Conquer: The Last Mile on Unsupervised Domain Adaptation for Semantic Segmentation27 Jun 2024
12 newest of 41 All 41 (JSON)