mlsanityData to 14 Oct 2026

CuRLA: Curriculum Learning Based Deep Reinforcement Learning for Autonomous Driving

arXiv 2501.04982 ↗First posted 9 Jan 2025cs.RO cs.AI cs.LGcited by 3

On the map: End-to-end autonomous driving → Reinforcement learning for driving

also in 1 more
Abstract (arXiv)

In autonomous driving, traditional Computer Vision (CV) agents often struggle in unfamiliar situations due to biases in the training data. Deep Reinforcement Learning (DRL) agents address this by learning from experience and maximizing rewards, which helps them adapt to dynamic environments. However, ensuring their generalization remains challenging, especially with static training environments. Additionally, DRL models lack transparency, making it difficult to guarantee safety in all scenarios, particularly those not seen during training. To tackle these issues, we propose a method that combines DRL with Curriculum Learning for autonomous driving. Our approach uses a Proximal Policy Optimization (PPO) agent and a Variational Autoencoder (VAE) to learn safe driving in the CARLA simulator. The agent is trained using two-fold curriculum learning, progressively increasing environment difficulty and incorporating a collision penalty in the reward function to promote safety. This method improves the agent's adaptability and reliability in complex environments, and understand the nuances of balancing multiple reward components from different feedback signals in a single scalar reward function. Keywords: Computer Vision, Deep Reinforcement Learning, Variational Autoencoder, Proximal Policy Optimization, Curriculum Learning, Autonomous Driving.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 10 of its 24 references that are in the map. First posted on arXiv 9 Jan 2025.

Builds on

10 of 24 references.

References · 10

  1. 2015Continuous control with deep reinforcement learningcited by 3,407
  2. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  3. 2015Trust Region Policy Optimizationcited by 2,580
  4. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  5. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
  6. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
  7. 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
  8. 2018Learning to Drive in a Daycited by 273
  9. 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 256
  10. 2020Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systemscited by 100

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Automatic Curriculum Learning for Driving Scenarios: Towards Robust and Efficient Reinforcement Learning
  2. 2025Vision based driving agent for race car simulation environments
  3. 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning
  4. 2026Scaling Curriculum Learning For Autonomous Driving
  5. 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator
  6. 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environment
  7. 2020Deep Reinforcement Learning for Autonomous Driving: A Survey
  8. 2023Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) for comfortable and safe autonomous driving