Deep Reinforcement Learning for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Reinforcement learning has steadily improved and outperform human in lots of traditional games since the resurgence of deep neural network. However, these success is not easy to be copied to autonomous driving because the state spaces in real world are extreme complex and action spaces are continuous and fine control is required. Moreover, the autonomous driving vehicles must also keep functional safety under the complex environments. To deal with these challenges, we first adopt the deep deterministic policy gradient (DDPG) algorithm, which has the capacity to handle complex state and action spaces in continuous domain. We then choose The Open Racing Car Simulator (TORCS) as our environment to avoid physical damage. Meanwhile, we select a set of appropriate sensor information from TORCS and design our own rewarder. In order to fit DDPG algorithm to TORCS, we design our network architecture for both actor and critic inside DDPG paradigm. To demonstrate the effectiveness of our model, We evaluate on different modes in TORCS and show both quantitative and qualitative results.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 8; 2023: 3; 2024: 6; 2025: 6; 2026: 2.
36 papers.
Sort:
By area:
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2024Learning Multimodal Behaviors from Scratch with Diffusion Policy Gradientcited by 51
- 2022Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Modelcited by 45
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 32
- 2021Feasible Actor-Critic: Constrained Reinforcement Learning for Ensuring Statewise Safetycited by 30
- 2021Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patternscited by 13
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policiescited by 10
- 2021Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Drivingcited by 9
- 2021Objective-aware Traffic Simulation via Inverse Reinforcement Learningcited by 8
- 2025HASARD: A Benchmark for Vision-Based Safe Reinforcement Learning in Embodied Agentscited by 6
- 2023Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Modelscited by 5
24 more
- 2023A Survey on Service Route and Time Prediction in Instant Delivery: Taxonomy, Progress, and Prospectscited by 5
- 2022Optimizing Trajectories for Highway Driving with Offline Reinforcement Learningcited by 4
- 2022CtrlFormer: Learning Transferable State Representation for Visual Control via Transformercited by 4
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Drivingcited by 3
- 2022ARLO: A Framework for Automated Reinforcement Learningcited by 3
- 2022GIN: Graph-based Interaction-aware Constraint Policy Optimization for Autonomous Drivingcited by 3
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challengescited by 3
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environmentcited by 2
- 2024Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learningcited by 2
- 2021Controlling an Inverted Pendulum with Policy Gradient Methods-A Tutorialcited by 1
- 2023Benchmarking Robustness of Deep Reinforcement Learning approaches to Online Portfolio Managementcited by 1
- 2025Robust Deterministic Policy Gradient for Disturbance Attenuation and Its Application to Quadrotor Controlcited by 1
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Drivingcited by 1
- 2021Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Drivingcited by 0
- 2022Discrete Control in Real-World Driving Environments using Deep Reinforcement Learningcited by 0
- 2024Markowitz Meets Bellman: Knowledge-distilled Reinforcement Learning for Portfolio Managementcited by 0
- 2024ATraDiff: Accelerating Online Reinforcement Learning with Imaginary Trajectoriescited by 0
- 2024Optimizing Low-Speed Autonomous Driving: A Reinforcement Learning Approach to Route Stability and Maximum Speedcited by 0
- 2025Exposing the Copycat Problem of Imitation-based Planner: A Novel Closed-Loop Simulator, Causal Benchmark and Joint IL-RL Baselinecited by 0
- 2025Hierarchical Deep Deterministic Policy Gradient for Autonomous Maze Navigation of Mobile Robotscited by 0
- 2025Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling for Strategic Multiagent Settingscited by 0
- 2026CRRL: A Causality-Based Reinforcement Learning Framework for Autonomous System Recoverycited by 0
- 2026CRRL: A Causality-Based Reinforcement Learning Framework for Autonomous System Recovery3 Jul 2026
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving7 Jun 2026
- 2025Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling for Strategic Multiagent Settings13 Nov 2025
- 2025Hierarchical Deep Deterministic Policy Gradient for Autonomous Maze Navigation of Mobile Robots7 Aug 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025Exposing the Copycat Problem of Imitation-based Planner: A Novel Closed-Loop Simulator, Causal Benchmark and Joint IL-RL Baseline20 Apr 2025
- 2025HASARD: A Benchmark for Vision-Based Safe Reinforcement Learning in Embodied Agents11 Mar 2025
- 2025Robust Deterministic Policy Gradient for Disturbance Attenuation and Its Application to Quadrotor Control28 Feb 2025
- 2024Optimizing Low-Speed Autonomous Driving: A Reinforcement Learning Approach to Route Stability and Maximum Speed20 Dec 2024
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey19 Aug 2024
- 2024ATraDiff: Accelerating Online Reinforcement Learning with Imaginary Trajectories6 Jun 2024
- 2024Learning Multimodal Behaviors from Scratch with Diffusion Policy Gradient2 Jun 2024
24 more
- 2024Markowitz Meets Bellman: Knowledge-distilled Reinforcement Learning for Portfolio Management8 May 2024
- 2024Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learning14 Feb 2024
- 2023A Survey on Service Route and Time Prediction in Instant Delivery: Taxonomy, Progress, and Prospects3 Sep 2023
- 2023Benchmarking Robustness of Deep Reinforcement Learning approaches to Online Portfolio Management19 Jun 2023
- 2023Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Models4 Apr 2023
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2022Discrete Control in Real-World Driving Environments using Deep Reinforcement Learning29 Nov 2022
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges12 Nov 2022
- 2022Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Model8 Oct 2022
- 2022CtrlFormer: Learning Transferable State Representation for Visual Control via Transformer17 Jun 2022
- 2022GIN: Graph-based Interaction-aware Constraint Policy Optimization for Autonomous Driving3 Jun 2022
- 2022ARLO: A Framework for Automated Reinforcement Learning20 May 2022
- 2022Optimizing Trajectories for Highway Driving with Offline Reinforcement Learning21 Mar 2022
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environment22 Dec 2021
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policies22 Dec 2021
- 2021Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Driving23 Nov 2021
- 2021Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patterns16 Sep 2021
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles29 May 2021
- 2021Feasible Actor-Critic: Constrained Reinforcement Learning for Ensuring Statewise Safety22 May 2021
- 2021Objective-aware Traffic Simulation via Inverse Reinforcement Learning20 May 2021
- 2021Controlling an Inverted Pendulum with Policy Gradient Methods-A Tutorial17 May 2021
- 2021Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Driving25 Mar 2021
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Driving16 Mar 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 32
- 2021Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patternscited by 13
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policiescited by 10
- 2021Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Drivingcited by 9
- 2022Optimizing Trajectories for Highway Driving with Offline Reinforcement Learningcited by 4
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Drivingcited by 3
- 2022GIN: Graph-based Interaction-aware Constraint Policy Optimization for Autonomous Drivingcited by 3
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environmentcited by 2
- 2021Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Drivingcited by 0
- 2022Discrete Control in Real-World Driving Environments using Deep Reinforcement Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2024Optimizing Low-Speed Autonomous Driving: A Reinforcement Learning Approach to Route Stability and Maximum Speed20 Dec 2024
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey19 Aug 2024
- 2022Discrete Control in Real-World Driving Environments using Deep Reinforcement Learning29 Nov 2022
- 2022GIN: Graph-based Interaction-aware Constraint Policy Optimization for Autonomous Driving3 Jun 2022
- 2022Optimizing Trajectories for Highway Driving with Offline Reinforcement Learning21 Mar 2022
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environment22 Dec 2021
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policies22 Dec 2021
- 2021Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Driving23 Nov 2021
- 2021Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patterns16 Sep 2021
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles29 May 2021
- 2021Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Driving25 Mar 2021
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Driving16 Mar 2021
12 newest of 13 All 13 (JSON)
- 2025HASARD: A Benchmark for Vision-Based Safe Reinforcement Learning in Embodied Agentscited by 6
- 2024Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learningcited by 2
- 2025Robust Deterministic Policy Gradient for Disturbance Attenuation and Its Application to Quadrotor Controlcited by 1
- 2024ATraDiff: Accelerating Online Reinforcement Learning with Imaginary Trajectoriescited by 0
- 2025Hierarchical Deep Deterministic Policy Gradient for Autonomous Maze Navigation of Mobile Robotscited by 0
- 2026CRRL: A Causality-Based Reinforcement Learning Framework for Autonomous System Recoverycited by 0
- 2026CRRL: A Causality-Based Reinforcement Learning Framework for Autonomous System Recovery3 Jul 2026
- 2025Hierarchical Deep Deterministic Policy Gradient for Autonomous Maze Navigation of Mobile Robots7 Aug 2025
- 2025HASARD: A Benchmark for Vision-Based Safe Reinforcement Learning in Embodied Agents11 Mar 2025
- 2025Robust Deterministic Policy Gradient for Disturbance Attenuation and Its Application to Quadrotor Control28 Feb 2025
- 2024ATraDiff: Accelerating Online Reinforcement Learning with Imaginary Trajectories6 Jun 2024
- 2024Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learning14 Feb 2024
- 2021Objective-aware Traffic Simulation via Inverse Reinforcement Learningcited by 8
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2025Exposing the Copycat Problem of Imitation-based Planner: A Novel Closed-Loop Simulator, Causal Benchmark and Joint IL-RL Baselinecited by 0
- 2025Exposing the Copycat Problem of Imitation-based Planner: A Novel Closed-Loop Simulator, Causal Benchmark and Joint IL-RL Baseline20 Apr 2025
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2021Objective-aware Traffic Simulation via Inverse Reinforcement Learning20 May 2021
- 2021Feasible Actor-Critic: Constrained Reinforcement Learning for Ensuring Statewise Safetycited by 30
- 2023Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Modelscited by 5
- 2023A Survey on Service Route and Time Prediction in Instant Delivery: Taxonomy, Progress, and Prospectscited by 5
- 2022CtrlFormer: Learning Transferable State Representation for Visual Control via Transformercited by 4
- 2022ARLO: A Framework for Automated Reinforcement Learningcited by 3
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challengescited by 3
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2021Controlling an Inverted Pendulum with Policy Gradient Methods-A Tutorialcited by 1
- 2023Benchmarking Robustness of Deep Reinforcement Learning approaches to Online Portfolio Managementcited by 1
- 2025Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling for Strategic Multiagent Settingscited by 0
- 2025Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling for Strategic Multiagent Settings13 Nov 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2023A Survey on Service Route and Time Prediction in Instant Delivery: Taxonomy, Progress, and Prospects3 Sep 2023
- 2023Benchmarking Robustness of Deep Reinforcement Learning approaches to Online Portfolio Management19 Jun 2023
- 2023Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Models4 Apr 2023
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges12 Nov 2022
- 2022CtrlFormer: Learning Transferable State Representation for Visual Control via Transformer17 Jun 2022
- 2022ARLO: A Framework for Automated Reinforcement Learning20 May 2022
- 2021Feasible Actor-Critic: Constrained Reinforcement Learning for Ensuring Statewise Safety22 May 2021
- 2021Controlling an Inverted Pendulum with Policy Gradient Methods-A Tutorial17 May 2021