A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios
On the map: End-to-end autonomous driving → Reinforcement learning for driving
Abstract (arXiv)
In recent years, control under urban intersection scenarios becomes an emerging research topic. In such scenarios, the autonomous vehicle confronts complicated situations since it must deal with the interaction with social vehicles timely while obeying the traffic rules. Generally, the autonomous vehicle is supposed to avoid collisions while pursuing better efficiency. The existing work fails to provide a framework that emphasizes the integrity of the scenarios while being able to deploy and test reinforcement learning(RL) methods. Specifically, we propose a benchmark for training and testing RL-based autonomous driving agents in complex intersection scenarios, which is called RL-CIS. Then, a set of baselines are deployed consists of various algorithms. The test benchmark and baselines are to provide a fair and comprehensive training and testing platform for the study of RL for autonomous driving in the intersection scenario, advancing the progress of RL-based methods for intersection autonomous driving control. The code of our proposed framework can be found at https://github.com/liuyuqi123/ComplexUrbanScenarios.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 13 of its 23 references that are in the map. First posted on arXiv 22 Sep 2021.
Builds on
13 of 23 references.
References · 13
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
- 2020A Survey of End-to-End Driving: Architectures and Training Methodscited by 123
- 2020SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Drivingcited by 121
- 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 99
- 2019SUMMIT: A Simulator for Urban Driving in Massive Mixed Trafficcited by 39
- 2019Social Attention for Autonomous Decision-Making in Dense Trafficcited by 39
- 2019Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraintscited by 24
- 2020BARK: Open Behavior Benchmarking in Multi-Agent Environmentscited by 21
- 2018Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Drivingcited by 17
1 more
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 1.
4 papers.
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awarenesscited by 12
- 2025Urban Computing in the Era of Large Language Modelscited by 2
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving4 Oct 2023
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness18 Sep 2023
Similar, not cited
Close in wording, no citation either way
- 2022Driver Dojo: A Benchmark for Generalizable Reinforcement Learning for Autonomous Driving
- 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study
- 2022Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery
- 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator
- 2025Balancing Progress and Safety: A Novel Risk-Aware Objective for RL in Autonomous Driving
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey
- 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective