A Survey of Deep Learning Techniques for Autonomous Driving
Not on the map. Why?
Cited by 43 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The last decade witnessed increasingly rapid progress in self-driving vehicle technology, mainly backed up by advances in the area of deep learning and artificial intelligence. The objective of this paper is to survey the current state-of-the-art on deep learning technologies used in autonomous driving. We start by presenting AI-based self-driving architectures, convolutional and recurrent neural networks, as well as the deep reinforcement learning paradigm. These methodologies form a base for the surveyed driving scene perception, path planning, behavior arbitration and motion control algorithms. We investigate both the modular perception-planning-action pipeline, where each module is built using deep learning methods, as well as End2End systems, which directly map sensory information to steering commands. Additionally, we tackle current challenges encountered in designing AI architectures for autonomous driving, such as their safety, training data sources and computational hardware. The comparison presented in this survey helps to gain insight into the strengths and limitations of deep learning and AI approaches for autonomous driving and assist with design choices
Key facts. Cited by 403 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 65; 2022: 66; 2023: 99; 2024: 78; 2025: 72; 2026: 23.
403 papers.
Sort:
By area:
- 2021Learning to Prompt for Continual Learningcited by 944
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2023A Comprehensive Survey of Dataset Distillationcited by 115
- 2021Theory of overparametrization in quantum neural networkscited by 100
- 2023Deep Model Fusion: A Surveycited by 91
- 2022Partially Observable Markov Decision Processes in Robotics: A Surveycited by 86
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 85
38 more
- 2021RobustART: Benchmarking Robustness on Architecture Design and Training Techniquescited by 79
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2022Calibrated Learning to Defer with One-vs-All Classifierscited by 69
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learningcited by 64
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibrationcited by 49
- 2022Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detectioncited by 46
- 2023LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programscited by 45
- 2021Offline Reinforcement Learning as Anti-Explorationcited by 44
- 2022ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotationscited by 44
- 2024DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Drivingcited by 43
- 2023Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challengescited by 40
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networkscited by 39
- 2023Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Drivingcited by 37
- 2021SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognitioncited by 36
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2023Fully Autonomous Programming with Large Language Modelscited by 31
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 30
- 2022VeriX: Towards Verified Explainability of Deep Neural Networkscited by 30
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022The Many Faces of Adversarial Riskcited by 28
- 2024From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimationcited by 28
- 2021Reachability Is NP-Complete Even for the Simplest Neural Networkscited by 27
- 2021Machine learning and deep learningcited by 26
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2023In Defense of Softmax Parametrization for Calibrated and Consistent Learning to Defercited by 26
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
- 2021Towards Robust Neural Networks via Close-loop Controlcited by 23
- 2022Towards Training Reproducible Deep Learning Modelscited by 23
- 2022GAMa: Cross-view Video Geo-localizationcited by 23
- 2023Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanationscited by 22
- 2025Flow Matching-Based Autonomous Driving Planning with Advanced Interactive Behavior Modelingcited by 22
- 2021CIFS: Improving Adversarial Robustness of CNNs via Channel-wise Importance-based Feature Selectioncited by 21
50 most cited of 403 All 403 (JSON)
- 2026Bayesian Data Augmentation for DNN Retraining with Binomial Outcomes in Vision-Based UAV Landing5 Oct 2026
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026One Perception, All Maneuvers: Directional Traffic Signal Understanding for Maneuver-Level Signal Intent Prediction26 Sep 2026
- 2026An Exploratory Study of Frequency-Aware Task Weighting for YOLOv8-Based Unified Driving Perception31 Aug 2026
- 2026SCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation19 Aug 2026
- 2026CORAL: Curriculum-Optimized Reward Adaptation for LiDAR-Based Goal-Directed Urban Driving14 Aug 2026
- 2026Extended Field of View Analysis for VideoGAN-based Trajectory Generation3 Aug 2026
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planning8 Jul 2026
- 2026Real-World Perturbation Testing of Autonomous Driving Systems6 Jul 2026
- 2026Beyond Self-Attention: Sub-Quadratic Vision Transformers for Fast Image Captioning7 Jun 2026
- 2026Does Appearance Help? A Systematic Study of Image-Based Re-Identification in Online 3D Multi-Pedestrian Tracking5 Jun 2026
- 2026Parameter-Free and Group Conditional Online Conformal Prediction29 May 2026
38 more
- 2026Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Driving12 May 2026
- 2026DIRCR: Dual-Inference Rule-Contrastive Reasoning for Solving RAVENs19 Apr 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026Probabilistic Tree Inference Enabled by FDSOI Ferroelectric FETs6 Apr 2026
- 2026Retina gap junctions support the robust perception by warping neural representational geometries along the visual hierarchy3 Apr 2026
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar 2026
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving18 Mar 2026
- 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving16 Mar 2026
- 2026Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection23 Feb 2026
- 2026Perception with Guarantees: Certified Pose Estimation via Reachability Analysis10 Feb 2026
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraints10 Feb 2026
- 2025Evaluating an Adaptive Multispectral Turret System for Autonomous Tracking Across Variable Illumination Conditions24 Dec 2025
- 2025Imitation Game: Reproducing Deep Learning Bugs Leveraging an Intelligent Agent17 Dec 2025
- 2025Bidirectional human-AI collaboration in brain tumour assessments improves both expert human and AI agent performance13 Dec 2025
- 2025Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation11 Dec 2025
- 2025Development and Testing for Perception Based Autonomous Landing of a Long-Range QuadPlane10 Dec 2025
- 2025A Geometric Unification of Concept Learning with Concept Cones8 Dec 2025
- 2025LAP: Fast LAtent Diffusion Planner for Autonomous Driving29 Nov 2025
- 2025Advancing Image Classification with Discrete Diffusion Classification Modeling25 Nov 2025
- 2025Enhancing Nuclear Reactor Core Simulation through Data-Based Surrogate Models20 Nov 2025
- 2025Exploiting Inter-Sample Information for Long-tailed Out-of-Distribution Detection20 Nov 2025
- 2025Enhancing End-to-End Autonomous Driving with Risk Semantic Distillaion from VLM18 Nov 2025
- 2025Torch-Uncertainty: A Deep Learning Framework for Uncertainty Quantification13 Nov 2025
- 2025LLEXICORP: End-user Explainability of Convolutional Neural Networks4 Nov 2025
- 2025Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training29 Oct 2025
- 2025Exploring Federated Learning for Thermal Urban Feature Segmentation -- A Comparison of Centralized and Decentralized Approaches28 Oct 2025
- 2025xMem: A CPU-Based Approach for Accurate Estimation of GPU Memory in Deep Learning Training Workloads23 Oct 2025
- 2025HAMLOCK: HArdware-Model LOgically Combined attacK22 Oct 2025
- 2025SAMix: Calibrated and Accurate Continual Learning via Sphere-Adaptive Mixup and Neural Collapse17 Oct 2025
- 2025Flow Matching-Based Autonomous Driving Planning with Advanced Interactive Behavior Modeling13 Oct 2025
- 2025Deep Neural Networks Inspired by Differential Equations9 Oct 2025
- 2025HyPlan: Hybrid Learning-Assisted Planning Under Uncertainty for Safe Autonomous Driving8 Oct 2025
- 2025Latent Uncertainty Representations for Video-based Driver Action and Intention Recognition6 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025Rounding-Guided Backdoor Injection in Deep Learning Model Quantization5 Oct 2025
- 2025TinyBEV: Cross Modal Knowledge Distillation for Efficient Multi Task Bird's Eye View Perception and Planning22 Sep 2025
- 2025Checking extracted rules in Neural Networks20 Sep 2025
- 2025GPU Temperature Simulation-Based Testing for In-Vehicle Deep Learning Frameworks19 Sep 2025
50 newest of 403 All 403 (JSON)
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2023LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programscited by 45
- 2024DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Drivingcited by 43
- 2021End-to-End Deep Learning of Lane Detection and Path Prediction for Real-Time Autonomous Drivingcited by 16
- 2024Reward-Driven Automated Curriculum Learning for Interaction-Aware Self-Driving at Unsignalized Intersectionscited by 10
- 2023Transcendental Idealism of Planner: Evaluating Perception from Planning Perspective for Autonomous Drivingcited by 9
- 2024Research on the Application of Computer Vision Based on Deep Learning in Autonomous Driving Technologycited by 9
- 2023Scaling Vision-based End-to-End Driving with Multi-View Attention Learningcited by 8
- 2025Collaborative Perception Datasets for Autonomous Driving: A Reviewcited by 8
- 2024Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Drivingcited by 7
12 most cited of 35 All 35 (JSON)
- 2026CORAL: Curriculum-Optimized Reward Adaptation for LiDAR-Based Goal-Directed Urban Driving14 Aug 2026
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planning8 Jul 2026
- 2026Real-World Perturbation Testing of Autonomous Driving Systems6 Jul 2026
- 2026Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Driving12 May 2026
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving18 Mar 2026
- 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving16 Mar 2026
- 2025HyPlan: Hybrid Learning-Assisted Planning Under Uncertainty for Safe Autonomous Driving8 Oct 2025
- 2025ME3-BEV: Mamba-Enhanced Deep Reinforcement Learning for End-to-End Autonomous Driving with BEV-Perception8 Aug 2025
- 2025Collaborative Perception Datasets for Autonomous Driving: A Review17 Apr 2025
- 2025Inverse RL Scene Dynamics Learning for Nonlinear Predictive Control in Autonomous Vehicles2 Apr 2025
- 2025Advancing Autonomous Vehicle Intelligence: Deep Learning and Multimodal LLM for Traffic Sign Recognition and Robust Lane Detection8 Mar 2025
- 2025CuRLA: Curriculum Learning Based Deep Reinforcement Learning for Autonomous Driving9 Jan 2025
12 newest of 35 All 35 (JSON)
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processingcited by 20
- 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Trickscited by 18
- 2023Towards Robust Model Watermark via Reducing Parametric Vulnerabilitycited by 10
- 2024IPA-NeRF: Illusory Poisoning Attack Against Neural Radiance Fieldscited by 5
- 2023MDTD: A Multi Domain Trojan Detector for Deep Neural Networkscited by 1
- 2025HAMLOCK: HArdware-Model LOgically Combined attacKcited by 0
- 2025HAMLOCK: HArdware-Model LOgically Combined attacK22 Oct 2025
- 2024IPA-NeRF: Illusory Poisoning Attack Against Neural Radiance Fields16 Jul 2024
- 2023Towards Robust Model Watermark via Reducing Parametric Vulnerability9 Sep 2023
- 2023MDTD: A Multi Domain Trojan Detector for Deep Neural Networks30 Aug 2023
- 2022Defending Backdoor Attacks on Vision Transformer via Patch Processing24 Jun 2022
- 2021Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks15 Oct 2021
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Drivingcited by 13
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 11
- 2023Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectoriescited by 6
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomycited by 1
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar 2026
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy12 Aug 2025
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving15 May 2024
- 2023Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectories17 Feb 2023
- 2025Flow Matching-Based Autonomous Driving Planning with Advanced Interactive Behavior Modelingcited by 22
- 2024Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Modelscited by 10
- 2023DataElixir: Purifying Poisoned Dataset to Mitigate Backdoor Attacks via Diffusion Modelscited by 9
- 2025LAP: Fast LAtent Diffusion Planner for Autonomous Drivingcited by 2
- 2025Advancing Image Classification with Discrete Diffusion Classification Modelingcited by 1
- 2025LAP: Fast LAtent Diffusion Planner for Autonomous Driving29 Nov 2025
- 2025Advancing Image Classification with Discrete Diffusion Classification Modeling25 Nov 2025
- 2025Flow Matching-Based Autonomous Driving Planning with Advanced Interactive Behavior Modeling13 Oct 2025
- 2024Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Models20 Sep 2024
- 2023DataElixir: Purifying Poisoned Dataset to Mitigate Backdoor Attacks via Diffusion Models18 Dec 2023
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
- 2025RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Drivingcited by 18
- 2024Hints of Prompt: Enhancing Visual Representation for Multimodal LLMs in Autonomous Drivingcited by 6
- 2025Enhancing End-to-End Autonomous Driving with Risk Semantic Distillaion from VLMcited by 0
- 2025Enhancing End-to-End Autonomous Driving with Risk Semantic Distillaion from VLM18 Nov 2025
- 2025RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Driving18 Mar 2025
- 2024Hints of Prompt: Enhancing Visual Representation for Multimodal LLMs in Autonomous Driving20 Nov 2024
- 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov 2023
- 2023Vision-Language Models for Vision Tasks: A Survey3 Apr 2023
- 2024HOPE: A Reinforcement Learning-based Hybrid Policy Path Planner for Diverse Parking Scenarioscited by 11
- 2025Drive Fast, Learn Faster: On-Board RL for High Performance Autonomous Racingcited by 3
- 2024Fast Explanations via Policy Gradient-Optimized Explainercited by 1
- 2025Towards a Reward-Free Reinforcement Learning Framework for Vehicle Controlcited by 0
- 2025Drive Fast, Learn Faster: On-Board RL for High Performance Autonomous Racing12 May 2025
- 2025Towards a Reward-Free Reinforcement Learning Framework for Vehicle Control21 Feb 2025
- 2024HOPE: A Reinforcement Learning-based Hybrid Policy Path Planner for Diverse Parking Scenarios31 May 2024
- 2024Fast Explanations via Policy Gradient-Optimized Explainer29 May 2024
- 2025Long-tailed Adversarial Training with Self-Distillationcited by 5
- 2021Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Datacited by 4
- 2025TinyBEV: Cross Modal Knowledge Distillation for Efficient Multi Task Bird's Eye View Perception and Planningcited by 0
- 2025TinyBEV: Cross Modal Knowledge Distillation for Efficient Multi Task Bird's Eye View Perception and Planning22 Sep 2025
- 2025Long-tailed Adversarial Training with Self-Distillation9 Mar 2025
- 2021Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data25 Mar 2021
- 2021Learning to Prompt for Continual Learningcited by 944
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2023A Comprehensive Survey of Dataset Distillationcited by 115
- 2021Theory of overparametrization in quantum neural networkscited by 100
- 2023Deep Model Fusion: A Surveycited by 91
- 2022Partially Observable Markov Decision Processes in Robotics: A Surveycited by 86
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 85
- 2021RobustART: Benchmarking Robustness on Architecture Design and Training Techniquescited by 79
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2022Calibrated Learning to Defer with One-vs-All Classifierscited by 69
12 most cited of 328 All 328 (JSON)
- 2026Bayesian Data Augmentation for DNN Retraining with Binomial Outcomes in Vision-Based UAV Landing5 Oct 2026
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026One Perception, All Maneuvers: Directional Traffic Signal Understanding for Maneuver-Level Signal Intent Prediction26 Sep 2026
- 2026An Exploratory Study of Frequency-Aware Task Weighting for YOLOv8-Based Unified Driving Perception31 Aug 2026
- 2026SCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation19 Aug 2026
- 2026Extended Field of View Analysis for VideoGAN-based Trajectory Generation3 Aug 2026
- 2026Beyond Self-Attention: Sub-Quadratic Vision Transformers for Fast Image Captioning7 Jun 2026
- 2026Does Appearance Help? A Systematic Study of Image-Based Re-Identification in Online 3D Multi-Pedestrian Tracking5 Jun 2026
- 2026Parameter-Free and Group Conditional Online Conformal Prediction29 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026Probabilistic Tree Inference Enabled by FDSOI Ferroelectric FETs6 Apr 2026
- 2026Retina gap junctions support the robust perception by warping neural representational geometries along the visual hierarchy3 Apr 2026
12 newest of 328 All 328 (JSON)