A Survey of Deep Learning Applications to Autonomous Vehicle Control
Not on the map. Why?
Cited by 22 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Designing a controller for autonomous vehicles capable of providing adequate performance in all driving scenarios is challenging due to the highly complex environment and inability to test the system in the wide variety of scenarios which it may encounter after deployment. However, deep learning methods have shown great promise in not only providing excellent performance for complex and non-linear control problems, but also in generalising previously learned rules to new scenarios. For these reasons, the use of deep learning for vehicle control is becoming increasingly popular. Although important advancements have been achieved in this field, these works have not been fully summarised. This paper surveys a wide range of research works reported in the literature which aim to control a vehicle through deep learning methods. Although there exists overlap between control and perception, the focus of this paper is on vehicle control, rather than the wider perception problem which includes tasks such as semantic segmentation and object detection. The paper identifies the strengths and limitations of available deep learning methods through comparative analysis and discusses the research challenges in terms of computation, architecture selection, goal specification, generalisation, verification and validation, as well as safety. Overall, this survey brings timely and topical information to a rapidly evolving field relevant to intelligent transportation systems.
Key facts. Cited by 106 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 19; 2022: 17; 2023: 24; 2024: 19; 2025: 14; 2026: 12.
106 papers.
Sort:
By area:
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
- 2022Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalizationcited by 97
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2023Semantic Segmentation using Vision Transformers: A surveycited by 73
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2023Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligencecited by 56
- 2022LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERTcited by 50
- 2023Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challengescited by 40
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022Graph Neural Networks in IoT: A Surveycited by 28
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
- 2021Spatio-Contextual Deep Network Based Multimodal Pedestrian Detection For Autonomous Drivingcited by 25
38 more
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviorscited by 25
- 2022Task-Free Continual Learning via Online Discrepancy Distance Learningcited by 22
- 2024An Information Theoretic Perspective on Conformal Predictioncited by 21
- 2022Automated Detection of Label Errors in Semantic Segmentation Datasets via Deep Learning and Uncertainty Quantificationcited by 20
- 2023Identifying Label Errors in Object Detection Datasets by Loss Inspectioncited by 16
- 2024SIGMA: Sinkhorn-Guided Masked Video Modelingcited by 14
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networkscited by 13
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2023Federated Transfer-Ordered-Personalized Learning for Driver Monitoring Applicationcited by 11
- 2022Stochastic Coded Federated Learning with Convergence and Privacy Guaranteescited by 10
- 2020Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectorycited by 8
- 2022fakeWeather: Adversarial Attacks for Deep Neural Networks Emulating Weather Conditions on the Camera Lens of Autonomous Systemscited by 8
- 2022Holistic Transformer: A Joint Neural Network for Trajectory Prediction and Decision-Making of Autonomous Vehiclescited by 8
- 2023Reachability Analysis of Neural Network Control Systemscited by 8
- 2023Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Surveycited by 8
- 2023Squeezed Edge YOLO: Onboard Object Detection on Edge Devicescited by 8
- 2021Machine Learning for Security in Vehicular Networks: A Comprehensive Surveycited by 7
- 2021Hybrid Car-Following Strategy based on Deep Deterministic Policy Gradient and Cooperative Adaptive Cruise Controlcited by 6
- 2023Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectoriescited by 6
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensorcited by 6
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2021The Graph Neural Networking Challenge: A Worldwide Competition for Education in AI/ML for Networkscited by 5
- 2024Deep Reinforcement Learning in Autonomous Car Path Planning and Control: A Surveycited by 5
- 2021Adversarial Mixture Density Networks: Learning to Drive Safely from Collision Datacited by 4
- 2022Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersectionscited by 4
- 2022Optimizing Trajectories for Highway Driving with Offline Reinforcement Learningcited by 4
- 2022Prediction Based Decision Making for Autonomous Highway Drivingcited by 4
- 2023Deep-Learning Framework for Optimal Selection of Soil Sampling Sitescited by 4
- 2023Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Controlcited by 4
- 2021ARC: Adversarially Robust Control Policies for Autonomous Vehiclescited by 3
- 2021Local Repair of Neural Networks Using Optimizationcited by 3
- 2021Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systemscited by 3
- 2022Distributed Resource Allocation for URLLC in IIoT Scenarios: A Multi-Armed Bandit Approachcited by 3
- 2023Towards Safe Autonomy in Hybrid Traffic: Detecting Unpredictable Abnormal Behaviors of Human Drivers via Information Sharingcited by 3
- 2024CrossCert: A Cross-Checking Detection Approach to Patch Robustness Certification for Deep Learning Modelscited by 3
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computingcited by 3
- 2024AI-Aided Kalman Filterscited by 3
- 2025Deep Learning-based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunitiescited by 3
50 most cited of 106 All 106 (JSON)
- 2026Actionable Meta-Requirements for AI Robustness Auditing9 Oct 2026
- 2026MRCert: Towards Post-deployment Patch Robustness Certification for Adversarially Patched Samples via Type-specific Masking7 Oct 2026
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2026CAffNet: Hard Constraint-Affine Neural Networks23 May 2026
- 2026Detecting Trojaned DNNs via Spectral Regression Analysis20 May 2026
- 2026Pedestrian-Aware LLM-Driven Behavioral Planning for Autonomous Vehicles16 May 2026
- 2026REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View12 May 2026
- 2026UniAda: Universal Adaptive Multi-objective Adversarial Attack for End-to-End Autonomous Driving Systems25 Apr 2026
- 2026CSC: Turning the Adversary's Poison against Itself23 Apr 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving13 Apr 2026
- 2026CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Control16 Mar 2026
38 more
- 2025BLIP-FusePPO: A Vision-Language Deep Reinforcement Learning Framework for Lane Keeping in Autonomous Vehicles25 Oct 2025
- 2025Multi-View Camera System for Variant-Aware Autonomous Vehicle Inspection and Defect Detection30 Sep 2025
- 2025Smaller is Better: Enhancing Transparency in Vehicle AI Systems via Pruning24 Sep 2025
- 2025TreeIRL: Safe Urban Driving with Tree Search and Inverse Reinforcement Learning16 Sep 2025
- 2025A holistic perception system of internal and external monitoring for ground autonomous vehicles: AutoTRUST paradigm25 Aug 2025
- 2025Learning to Detect Label Errors by Making Them: A Method for Segmentation and Object Detection Datasets25 Aug 2025
- 2025Deep Learning-based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunities23 Aug 2025
- 2025From Label Error Detection to Correction: A Modular Framework and Benchmark for Object Detection Datasets6 Aug 2025
- 2025AEGIS: Human Attention-based Explainable Guidance for Intelligent Vehicle Systems8 Apr 2025
- 2025CORTEX-AVD: A Framework for CORner Case Testing and EXploration in Autonomous Vehicle Development4 Apr 2025
- 2025Solving 2-D Helmholtz equation in the rectangular, circular, and elliptical domains using neural networks26 Mar 2025
- 2025Understanding Driver Cognition and Decision-Making Behaviors in High-Risk Scenarios: A Drift Diffusion Perspective16 Mar 2025
- 2025Synthetic Data Generation for Minimum-Exposure Navigation in a Time-Varying Environment using Generative AI Models9 Mar 2025
- 2025Navigating the Edge with the State-of-the-Art Insights into Corner Case Identification and Generation for Enhanced Autonomous Vehicle Safety27 Feb 2025
- 2024Camera-Based Localization and Enhanced Normalized Mutual Information20 Dec 2024
- 2024AI-Aided Kalman Filters16 Oct 2024
- 2024Fast and Modular Autonomy Software for Autonomous Racing Vehicles27 Aug 2024
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities22 Aug 2024
- 2024Query-Efficient Video Adversarial Attack with Stylized Logo on Service Computing22 Aug 2024
- 2024SIGMA: Sinkhorn-Guided Masked Video Modeling22 Jul 2024
- 20243D Adaptive Structural Convolution Network for Domain-Invariant Point Cloud Recognition5 Jul 2024
- 2024Physics-informed Imitative Reinforcement Learning for Real-world Driving18 Jun 2024
- 2024Deep Reinforcement Learning-based Quadcopter Controller: A Practical Approach and Experiments13 Jun 2024
- 2024CrossCert: A Cross-Checking Detection Approach to Patch Robustness Certification for Deep Learning Models13 May 2024
- 2024Autonomous Driving with a Deep Dual-Model Solution for Steering and Braking Control10 May 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detection9 May 2024
- 2024Unified End-to-End V2X Cooperative Autonomous Driving7 May 2024
- 2024An Information Theoretic Perspective on Conformal Prediction3 May 2024
- 2024Minimum Description Feature Selection for Complexity Reduction in Machine Learning-based Wireless Positioning21 Apr 2024
- 2024Deep Reinforcement Learning in Autonomous Car Path Planning and Control: A Survey30 Mar 2024
- 2024Demystifying the Physics of Deep Reinforcement Learning-Based Autonomous Vehicle Decision-Making18 Mar 2024
- 2024Bayesian Deep Learning Via Expectation Maximization and Turbo Deep Approximate Message Passing12 Feb 2024
- 2024Motion Mapping Cognition: A Nondecomposable Primary Process in Human Vision2 Feb 2024
- 2023Squeezed Edge YOLO: Onboard Object Detection on Edge Devices18 Dec 2023
- 2023Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control30 Nov 2023
- 2023Panda or not Panda? Understanding Adversarial Attacks with Interactive Visualization22 Nov 2023
- 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov 2023
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensor17 Nov 2023
50 newest of 106 All 106 (JSON)
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networkscited by 13
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2022Optimizing Trajectories for Highway Driving with Offline Reinforcement Learningcited by 4
- 2022Prediction Based Decision Making for Autonomous Highway Drivingcited by 4
- 2021ARC: Adversarially Robust Control Policies for Autonomous Vehiclescited by 3
- 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
- 2024Physics-informed Imitative Reinforcement Learning for Real-world Drivingcited by 2
- 2021Weakly Supervised Reinforcement Learning for Autonomous Highway Driving via Virtual Safety Cagescited by 1
- 2021Parallelized and Randomized Adversarial Imitation Learning for Safety-Critical Self-Driving Vehiclescited by 1
- 2023Review of Deep Reinforcement Learning for Autonomous Drivingcited by 1
12 most cited of 20 All 20 (JSON)
- 2026Pedestrian-Aware LLM-Driven Behavioral Planning for Autonomous Vehicles16 May 2026
- 2026UniAda: Universal Adaptive Multi-objective Adversarial Attack for End-to-End Autonomous Driving Systems25 Apr 2026
- 2026MVAdapt: Zero-Shot Multi-Vehicle Adaptation for End-to-End Autonomous Driving13 Apr 2026
- 2025TreeIRL: Safe Urban Driving with Tree Search and Inverse Reinforcement Learning16 Sep 2025
- 2025A holistic perception system of internal and external monitoring for ground autonomous vehicles: AutoTRUST paradigm25 Aug 2025
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities22 Aug 2024
- 2024Physics-informed Imitative Reinforcement Learning for Real-world Driving18 Jun 2024
- 2024Unified End-to-End V2X Cooperative Autonomous Driving7 May 2024
- 2024Demystifying the Physics of Deep Reinforcement Learning-Based Autonomous Vehicle Decision-Making18 Mar 2024
- 2023An Overview about Emerging Technologies of Autonomous Driving23 Jun 2023
- 2023Review of Deep Reinforcement Learning for Autonomous Driving13 Feb 2023
- 2022Prediction Based Decision Making for Autonomous Highway Driving5 Sep 2022
12 newest of 20 All 20 (JSON)
- 2024Deep Reinforcement Learning in Autonomous Car Path Planning and Control: A Surveycited by 5
- 2024Deep Reinforcement Learning-based Quadcopter Controller: A Practical Approach and Experimentscited by 1
- 2026CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Controlcited by 0
- 2026CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Control16 Mar 2026
- 2024Deep Reinforcement Learning-based Quadcopter Controller: A Practical Approach and Experiments13 Jun 2024
- 2024Deep Reinforcement Learning in Autonomous Car Path Planning and Control: A Survey30 Mar 2024
- 2020Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectorycited by 8
- 2021Adversarial Mixture Density Networks: Learning to Drive Safely from Collision Datacited by 4
- 2022Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersectionscited by 4
- 2022Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersections21 Feb 2022
- 2021Adversarial Mixture Density Networks: Learning to Drive Safely from Collision Data9 Jul 2021
- 2020Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory20 Oct 2020
- 2026CSC: Turning the Adversary's Poison against Itselfcited by 0
- 2026CSC: Turning the Adversary's Poison against Itself23 Apr 2026
- 2022Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalizationcited by 97
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2023Semantic Segmentation using Vision Transformers: A surveycited by 73
- 2023Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligencecited by 56
- 2022LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERTcited by 50
- 2023Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challengescited by 40
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022Graph Neural Networks in IoT: A Surveycited by 28
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
- 2021Spatio-Contextual Deep Network Based Multimodal Pedestrian Detection For Autonomous Drivingcited by 25
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviorscited by 25
- 2022Task-Free Continual Learning via Online Discrepancy Distance Learningcited by 22
12 most cited of 76 All 76 (JSON)
- 2026Actionable Meta-Requirements for AI Robustness Auditing9 Oct 2026
- 2026MRCert: Towards Post-deployment Patch Robustness Certification for Adversarially Patched Samples via Type-specific Masking7 Oct 2026
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2026CAffNet: Hard Constraint-Affine Neural Networks23 May 2026
- 2026Detecting Trojaned DNNs via Spectral Regression Analysis20 May 2026
- 2026REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View12 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2025Multi-View Camera System for Variant-Aware Autonomous Vehicle Inspection and Defect Detection30 Sep 2025
- 2025Smaller is Better: Enhancing Transparency in Vehicle AI Systems via Pruning24 Sep 2025
- 2025Learning to Detect Label Errors by Making Them: A Method for Segmentation and Object Detection Datasets25 Aug 2025
- 2025Deep Learning-based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunities23 Aug 2025
- 2025From Label Error Detection to Correction: A Modular Framework and Benchmark for Object Detection Datasets6 Aug 2025
12 newest of 76 All 76 (JSON)