mlsanityData to 7 Oct 2026

A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios

arXiv 2109.10557 ↗First posted 22 Sep 2021cs.AI cs.ROcited by 4

On the map: End-to-end autonomous driving → Reinforcement learning for driving

Abstract (arXiv)

In recent years, control under urban intersection scenarios becomes an emerging research topic. In such scenarios, the autonomous vehicle confronts complicated situations since it must deal with the interaction with social vehicles timely while obeying the traffic rules. Generally, the autonomous vehicle is supposed to avoid collisions while pursuing better efficiency. The existing work fails to provide a framework that emphasizes the integrity of the scenarios while being able to deploy and test reinforcement learning(RL) methods. Specifically, we propose a benchmark for training and testing RL-based autonomous driving agents in complex intersection scenarios, which is called RL-CIS. Then, a set of baselines are deployed consists of various algorithms. The test benchmark and baselines are to provide a fair and comprehensive training and testing platform for the study of RL for autonomous driving in the intersection scenario, advancing the progress of RL-based methods for intersection autonomous driving control. The code of our proposed framework can be found at https://github.com/liuyuqi123/ComplexUrbanScenarios.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 13 of its 23 references that are in the map. First posted on arXiv 22 Sep 2021.

Builds on

13 of 23 references.

References · 13

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  2. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
  3. 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
  4. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  5. 2020A Survey of End-to-End Driving: Architectures and Training Methodscited by 123
  6. 2020SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Drivingcited by 121
  7. 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 99
  8. 2019SUMMIT: A Simulator for Urban Driving in Massive Mixed Trafficcited by 39
  9. 2019Social Attention for Autonomous Decision-Making in Dense Trafficcited by 39
  10. 2019Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraintscited by 24
  11. 2020BARK: Open Behavior Benchmarking in Multi-Agent Environmentscited by 21
  12. 2018Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Drivingcited by 17
1 more
  1. 2018Learning Negotiating Behavior Between Cars in Intersections using Deep Q-Learningcited by 13

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1; 2025: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022Driver Dojo: A Benchmark for Generalizable Reinforcement Learning for Autonomous Driving
  2. 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions
  3. 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study
  4. 2022Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery
  5. 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator
  6. 2025Balancing Progress and Safety: A Novel Risk-Aware Objective for RL in Autonomous Driving
  7. 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey
  8. 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective