Deep Reinforcement Learning framework for Autonomous Driving
Not on the map. Why?
Cited by 37 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes. Despite its perceived utility, it has not yet been successfully applied in automotive applications. Motivated by the successful demonstrations of learning of Atari games and Go by Google DeepMind, we propose a framework for autonomous driving using deep reinforcement learning. This is of particular relevance as it is difficult to pose autonomous driving as a supervised learning problem due to strong interactions with the environment including other vehicles, pedestrians and roadworks. As it is a relatively new area of research for autonomous driving, we provide a short overview of deep reinforcement learning and then describe our proposed framework. It incorporates Recurrent Neural Networks for information integration, enabling the car to handle partially observable scenarios. It also integrates the recent work on attention models to focus on relevant information, thereby reducing the computational complexity for deployment on embedded hardware. The framework was tested in an open source 3D car racing simulator called TORCS. Our simulation results demonstrate learning of autonomous maneuvering in a scenario of complex road curvatures and simple interaction of other vehicles.
Key facts. Cited by 224 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 1; 2020: 2; 2021: 69; 2022: 47; 2023: 34; 2024: 28; 2025: 27; 2026: 15.
224 papers.
Sort:
By area:
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 582
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 133
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 128
- 2022A Review of Off-Policy Evaluation in Reinforcement Learningcited by 92
- 2021Federated Reinforcement Learning: Techniques, Applications, and Open Challengescited by 79
- 2021Off-Policy Imitation Learning from Observationscited by 70
- 2021Offline Reinforcement Learning: Fundamental Barriers for Value Function Approximationcited by 69
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2023TorchRL: A data-driven decision-making library for PyTorchcited by 59
38 more
- 2021A Survey of Machine Learning for Computer Architecture and Systemscited by 53
- 2021Decentralized Q-Learning in Zero-sum Markov Gamescited by 53
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 49
- 2021Triangle Attack: A Query-efficient Decision-based Adversarial Attackcited by 48
- 2021Offline Reinforcement Learning as Anti-Explorationcited by 44
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 41
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2021Deeply-Debiased Off-Policy Interval Estimationcited by 36
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2023Policy Optimization for Continuous Reinforcement Learningcited by 30
- 2021Offline Reinforcement Learning for Autonomous Driving with Safety and Exploration Enhancementcited by 28
- 2021FedAdapt: Adaptive Offloading for IoT Devices in Federated Learningcited by 26
- 2021Online Bootstrap Inference For Policy Evaluation in Reinforcement Learningcited by 26
- 2022Contrastive UCB: Provably Efficient Contrastive Self-Supervised Learning in Online Reinforcement Learningcited by 26
- 2021Integrated Decision and Control: Towards Interpretable and Computationally Efficient Driving Intelligencecited by 25
- 2021Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learningcited by 25
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 25
- 2022BAFFLE: Hiding Backdoors in Offline Reinforcement Learning Datasetscited by 24
- 2022What is the Solution for State-Adversarial Multi-Agent Reinforcement Learning?cited by 21
- 2022Offline Reinforcement Learning with Differential Privacycited by 19
- 2023Reward Shaping for Happier Autonomous Cyber Security Agentscited by 19
- 2021Faults in Deep Reinforcement Learning Programs: A Taxonomy and A Detection Approachcited by 18
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2021Gym-ANM: Reinforcement Learning Environments for Active Network Management Tasks in Electricity Distribution Systemscited by 18
- 2021Black-Box Testing of Deep Neural Networks Through Test Case Diversitycited by 18
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2021Finite-Sample Analysis of Off-Policy TD-Learning via Generalized Bellman Operatorscited by 17
- 2023Inroads into Autonomous Network Defence using Explained Reinforcement Learningcited by 17
- 2024LangProp: A code optimization framework using Large Language Models applied to drivingcited by 17
- 2021Human-in-the-Loop Deep Reinforcement Learning with Application to Autonomous Drivingcited by 16
- 2021Optimistic Policy Optimization is Provably Efficient in Non-stationary MDPscited by 16
- 2022CADRE: A Cascade Deep Reinforcement Learning Framework for Vision-based Autonomous Urban Drivingcited by 16
- 2022Near-Optimal Differentially Private Reinforcement Learningcited by 16
- 2023SaFormer: A Conditional Sequence Modeling Approach to Offline Safe Reinforcement Learningcited by 16
- 2022Hybrid Reinforcement Learning-Based Eco-Driving Strategy for Connected and Automated Vehicles at Signalized Intersectionscited by 15
- 2022Reinforcement Learning in Medical Image Analysis: Concepts, Applications, Challenges, and Future Directionscited by 15
- 2023Online Learning in Stackelberg Games with an Omniscient Followercited by 15
50 most cited of 224 All 224 (JSON)
- 2026Certifying Lower Bounds for Risk-Sensitive Reinforcement Learning under Adversarial State Perturbations9 Sep 2026
- 2026T3S: Improving Multi-Task Reinforcement Learning with Task-Specific Feature Selector and Scheduler31 Aug 2026
- 2026Learning from the Test: Self-Referential Differential Testing for Deep RL Agents23 Aug 2026
- 2026Learning Lookahead Lemmas for Neural Network Verification31 Jul 2026
- 2026Lookahead Branching for Neural Network Verification19 Jul 2026
- 2026CoRe: Combined Rewards with Vision-Language Model Feedback for Preference-Aligned Reinforcement Learning2 Jul 2026
- 2026PolicyGuard: Towards Test-time and Step-level Adversary (Backdoor) Defense for Reinforcement Learning Agent11 Jun 2026
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving7 Jun 2026
- 2026When Does Adaptive Guidance Help? Belief-Aware Privileged Distillation for Autonomous Driving Under Partial Observability24 May 2026
- 2026AGPO: Asymmetric Group Policy Optimization for Verifiable Reasoning and Search Ads Relevance at JD7 May 2026
- 2026Transferable Physical-World Adversarial Patches Against Object Detection in Autonomous Driving25 Apr 2026
- 2026Robust Adversarial Policy Optimization Under Dynamics Uncertainty13 Apr 2026
38 more
- 2026Formal Synthesis of Certifiably Robust Neural Lyapunov-Barrier Certificates5 Feb 2026
- 2026Implicit Q-Learning and SARSA: Liberating Policy Control from Step-Size Calibration26 Jan 2026
- 2026Multi-agent DRL-based Lane Change Decision Model for Cooperative Platooning in Mixed Traffic16 Jan 2026
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies1 Dec 2025
- 2025Object-Centric World Models for Causality-Aware Reinforcement Learning18 Nov 2025
- 2025Directional-Clamp PPO4 Nov 2025
- 2025Deep Reinforcement Learning for Multi-Agent Coordination4 Oct 2025
- 2025DeepProv: Behavioral Characterization and Repair of Neural Networks via Inference Provenance Graph Analysis30 Sep 2025
- 2025Informed Asymmetric Actor-Critic: Leveraging Privileged Signals Beyond Full-State Access30 Sep 2025
- 2025Learning Distinguishable Representations in Deep Q-Networks for Linear Transfer29 Sep 2025
- 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator10 Sep 2025
- 2025Adversarial Agent Behavior Learning in Autonomous Driving Using Deep Reinforcement Learning21 Aug 2025
- 2025Comparing Behavioural Cloning and Reinforcement Learning for Spacecraft Guidance and Control Networks22 Jul 2025
- 2025Towards Autonomous Riding: A Review of Perception, Planning, and Control in Intelligent Two-Wheelers16 Jul 2025
- 2025"So, Tell Me About Your Policy...": Distillation of interpretable policies from Deep Reinforcement Learning agents10 Jul 2025
- 2025SENIOR: Efficient Query Selection and Preference-Guided Exploration in Preference-based Reinforcement Learning17 Jun 2025
- 2025Revealing the Challenges of Sim-to-Real Transfer in Model-Based Reinforcement Learning via Latent Space Modeling15 Jun 2025
- 2025Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Control30 May 2025
- 2025A Snapshot of Influence: A Local Data Attribution Framework for Online Reinforcement Learning25 May 2025
- 2025Finite-Time Global Optimality Convergence in Deep Neural Actor-Critic Methods for Decentralized Multi-Agent Reinforcement Learning24 May 2025
- 2025Imagination-Limited Q-Learning for Offline Reinforcement Learning18 May 2025
- 2025Towards Optimal Differentially Private Regret Bounds in Linear MDPs12 Apr 2025
- 2025CHARMS: A Cognitive Hierarchical Agent for Reasoning and Motion Stylization in Autonomous Driving3 Apr 2025
- 2025Edge AI-Powered Real-Time Decision-Making for Autonomous Vehicles in Adverse Weather Conditions12 Mar 2025
- 2025Balancing SoC in Battery Cells using Safe Action Perturbations11 Mar 2025
- 2025ZIA: A Theoretical Framework for Zero-Input AI22 Feb 2025
- 2025Diverse Transformer Decoding for Offline Reinforcement Learning Using Financial Algorithmic Approaches13 Feb 2025
- 2025Safeguarding connected autonomous vehicle communication: Protocols, intra- and inter-vehicular attacks and defenses6 Feb 2025
- 2025Dream to Drive with Predictive Individual World Model28 Jan 2025
- 2025Learn A Flexible Exploration Model for Parameterized Action Markov Decision Processes6 Jan 2025
- 2024Low-Rank Contextual Reinforcement Learning from Heterogeneous Human Feedback27 Dec 2024
- 2024Upside-Down Reinforcement Learning for More Interpretable Optimal Control18 Nov 2024
- 2024Beyond Simple Sum of Delayed Rewards: Non-Markovian Reward Modeling for Reinforcement Learning26 Oct 2024
- 2024Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Making18 Oct 2024
- 2024Multi-Agent Actor-Critics in Autonomous Cyber Defense11 Oct 2024
- 2024From Imitation to Exploration: End-to-end Autonomous Driving based on World Model3 Oct 2024
- 2024Cognitive Kernel: An Open-source Agent System towards Generalist Autopilots16 Sep 2024
- 2024Review of Cloud Service Composition for Intelligent Manufacturing3 Aug 2024
50 newest of 224 All 224 (JSON)
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2021Offline Reinforcement Learning for Autonomous Driving with Safety and Exploration Enhancementcited by 28
- 2021Integrated Decision and Control: Towards Interpretable and Computationally Efficient Driving Intelligencecited by 25
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2024LangProp: A code optimization framework using Large Language Models applied to drivingcited by 17
- 2021Human-in-the-Loop Deep Reinforcement Learning with Application to Autonomous Drivingcited by 16
- 2022CADRE: A Cascade Deep Reinforcement Learning Framework for Vision-based Autonomous Urban Drivingcited by 16
- 2022Hybrid Reinforcement Learning-Based Eco-Driving Strategy for Connected and Automated Vehicles at Signalized Intersectionscited by 15
- 2021Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Drivingcited by 9
- 2024Generating and Evolving Reward Functions for Highway Driving with Large Language Modelscited by 8
- 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulatorcited by 7
12 most cited of 35 All 35 (JSON)
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies1 Dec 2025
- 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator10 Sep 2025
- 2025Adversarial Agent Behavior Learning in Autonomous Driving Using Deep Reinforcement Learning21 Aug 2025
- 2025CHARMS: A Cognitive Hierarchical Agent for Reasoning and Motion Stylization in Autonomous Driving3 Apr 2025
- 2025Edge AI-Powered Real-Time Decision-Making for Autonomous Vehicles in Adverse Weather Conditions12 Mar 2025
- 2024Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Making18 Oct 2024
- 2024Multi-Task Lane-Free Driving Strategy for Connected and Automated Vehicles: A Multi-Agent Deep Reinforcement Learning Approach20 Jun 2024
- 2024Generating and Evolving Reward Functions for Highway Driving with Large Language Models15 Jun 2024
- 2024LORD: Large Models based Opposite Reward Design for Autonomous Driving27 Mar 2024
- 2024Autonomous vehicle decision and control through reinforcement learning with traffic flow randomization5 Mar 2024
- 2024LangProp: A code optimization framework using Large Language Models applied to driving18 Jan 2024
- 2023DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data8 Oct 2023
12 newest of 35 All 35 (JSON)
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 582
- 2021Off-Policy Imitation Learning from Observationscited by 70
- 2021Offline Reinforcement Learning: Fundamental Barriers for Value Function Approximationcited by 69
- 2021Offline Reinforcement Learning as Anti-Explorationcited by 44
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 25
- 2022BAFFLE: Hiding Backdoors in Offline Reinforcement Learning Datasetscited by 24
- 2022Offline Reinforcement Learning with Differential Privacycited by 19
- 2023SaFormer: A Conditional Sequence Modeling Approach to Offline Safe Reinforcement Learningcited by 16
- 2022Offline Reinforcement Learning with Closed-Form Policy Improvement Operatorscited by 14
- 2023Uncertainty-driven Trajectory Truncation for Data Augmentation in Offline Reinforcement Learningcited by 13
- 2023Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidancecited by 13
12 most cited of 25 All 25 (JSON)
- 2026Learning from the Test: Self-Referential Differential Testing for Deep RL Agents23 Aug 2026
- 2025Comparing Behavioural Cloning and Reinforcement Learning for Spacecraft Guidance and Control Networks22 Jul 2025
- 2025Imagination-Limited Q-Learning for Offline Reinforcement Learning18 May 2025
- 2025Diverse Transformer Decoding for Offline Reinforcement Learning Using Financial Algorithmic Approaches13 Feb 2025
- 2024SENSOR: Imitate Third-Person Expert's Behaviors via Active Sensoring4 Apr 2024
- 2023Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidance4 Sep 2023
- 2023Uncertainty-driven Trajectory Truncation for Data Augmentation in Offline Reinforcement Learning10 Apr 2023
- 2023Communication Load Balancing via Efficient Inverse Reinforcement Learning22 Mar 2023
- 2023SaFormer: A Conditional Sequence Modeling Approach to Offline Safe Reinforcement Learning28 Jan 2023
- 2022Offline Reinforcement Learning with Closed-Form Policy Improvement Operators29 Nov 2022
- 2022Wall Street Tree Search: Risk-Aware Planning for Offline Reinforcement Learning6 Nov 2022
- 2022BAFFLE: Hiding Backdoors in Offline Reinforcement Learning Datasets7 Oct 2022
12 newest of 25 All 25 (JSON)
- 2023Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation and Human Feedbackcited by 13
- 2024Low-Rank Contextual Reinforcement Learning from Heterogeneous Human Feedbackcited by 10
- 2024Beyond Simple Sum of Delayed Rewards: Non-Markovian Reward Modeling for Reinforcement Learningcited by 2
- 2025SENIOR: Efficient Query Selection and Preference-Guided Exploration in Preference-based Reinforcement Learningcited by 1
- 2025SENIOR: Efficient Query Selection and Preference-Guided Exploration in Preference-based Reinforcement Learning17 Jun 2025
- 2024Low-Rank Contextual Reinforcement Learning from Heterogeneous Human Feedback27 Dec 2024
- 2024Beyond Simple Sum of Delayed Rewards: Non-Markovian Reward Modeling for Reinforcement Learning26 Oct 2024
- 2023Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation and Human Feedback6 Jul 2023
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 133
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 128
- 2022A Review of Off-Policy Evaluation in Reinforcement Learningcited by 92
- 2021Federated Reinforcement Learning: Techniques, Applications, and Open Challengescited by 79
- 2023TorchRL: A data-driven decision-making library for PyTorchcited by 59
- 2021A Survey of Machine Learning for Computer Architecture and Systemscited by 53
- 2021Decentralized Q-Learning in Zero-sum Markov Gamescited by 53
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 49
- 2021Triangle Attack: A Query-efficient Decision-based Adversarial Attackcited by 48
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
12 most cited of 151 All 151 (JSON)
- 2026Certifying Lower Bounds for Risk-Sensitive Reinforcement Learning under Adversarial State Perturbations9 Sep 2026
- 2026T3S: Improving Multi-Task Reinforcement Learning with Task-Specific Feature Selector and Scheduler31 Aug 2026
- 2026Learning Lookahead Lemmas for Neural Network Verification31 Jul 2026
- 2026Lookahead Branching for Neural Network Verification19 Jul 2026
- 2026When Does Adaptive Guidance Help? Belief-Aware Privileged Distillation for Autonomous Driving Under Partial Observability24 May 2026
- 2026Transferable Physical-World Adversarial Patches Against Object Detection in Autonomous Driving25 Apr 2026
- 2026Robust Adversarial Policy Optimization Under Dynamics Uncertainty13 Apr 2026
- 2026Formal Synthesis of Certifiably Robust Neural Lyapunov-Barrier Certificates5 Feb 2026
- 2026Implicit Q-Learning and SARSA: Liberating Policy Control from Step-Size Calibration26 Jan 2026
- 2026Multi-agent DRL-based Lane Change Decision Model for Cooperative Platooning in Mixed Traffic16 Jan 2026
- 2025Directional-Clamp PPO4 Nov 2025
- 2025Deep Reinforcement Learning for Multi-Agent Coordination4 Oct 2025
12 newest of 151 All 151 (JSON)