Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Providing an efficient strategy to navigate safely through unsignaled intersections is a difficult task that requires determining the intent of other drivers. We explore the effectiveness of Deep Reinforcement Learning to handle intersection problems. Using recent advances in Deep RL, we are able to learn policies that surpass the performance of a commonly-used heuristic approach in several metrics including task completion time and goal success rate and have limited ability to generalize. We then explore a system's ability to learn active sensing behaviors to enable navigating safely in the case of occlusions. Our analysis, provides insight into the intersection handling problem, the solutions learned by the network point out several shortcomings of current rule-based methods, and the failures of our current deep reinforcement learning system point to future research directions.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 11; 2022: 5; 2023: 4.
21 papers.
Sort:
By area:
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Drivingcited by 17
- 2022State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersectionscited by 15
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learningcited by 13
- 2018OIL: Observational Imitation Learningcited by 11
- 2021Learning to Navigate Intersections with Unsupervised Driver Trait Inferencecited by 8
- 2021End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learningcited by 6
- 2021Experience-Based Heuristic Search: Robust Motion Planning with Deep Q-Learningcited by 4
- 2021Formulation and validation of a car-following model based on deep reinforcement learningcited by 4
- 2023Deep Q-Network Based Decision Making for Autonomous Drivingcited by 4
- 2021Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learningcited by 3
- 2021Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersectioncited by 3
9 more
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2021Pedestrian Collision Avoidance for Autonomous Vehicles at Unsignalized Intersection Using Deep Q-Networkcited by 2
- 2022Improve Generalization of Driving Policy at Signalized Intersections with Adversarial Learningcited by 2
- 2021High-level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Mergingcited by 1
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learningcited by 1
- 2022Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discoverycited by 1
- 2023Review of Deep Reinforcement Learning for Autonomous Drivingcited by 1
- 2023Intersection Warning System for Occlusion Risks using Relational Local Dynamic Mapscited by 0
- 2023Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applicationscited by 0
- 2023Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applications9 Jun 2023
- 2023Deep Q-Network Based Decision Making for Autonomous Driving21 Mar 2023
- 2023Intersection Warning System for Occlusion Risks using Relational Local Dynamic Maps13 Mar 2023
- 2023Review of Deep Reinforcement Learning for Autonomous Driving13 Feb 2023
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2022Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery24 Jul 2022
- 2022State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections10 Jul 2022
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning11 May 2022
- 2022Improve Generalization of Driving Policy at Signalized Intersections with Adversarial Learning9 Apr 2022
- 2021Formulation and validation of a car-following model based on deep reinforcement learning29 Sep 2021
- 2021Learning to Navigate Intersections with Unsupervised Driver Trait Inference14 Sep 2021
- 2021High-level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Merging15 Jul 2021
9 more
- 2021Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersection8 Jun 2021
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Driving21 May 2021
- 2021Pedestrian Collision Avoidance for Autonomous Vehicles at Unsignalized Intersection Using Deep Q-Network1 May 2021
- 2021End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learning28 Apr 2021
- 2021Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learning12 Feb 2021
- 2021Experience-Based Heuristic Search: Robust Motion Planning with Deep Q-Learning5 Feb 2021
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learning5 Feb 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
- 2018OIL: Observational Imitation Learning3 Mar 2018
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Drivingcited by 17
- 2022State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersectionscited by 15
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learningcited by 13
- 2023Deep Q-Network Based Decision Making for Autonomous Drivingcited by 4
- 2021Pedestrian Collision Avoidance for Autonomous Vehicles at Unsignalized Intersection Using Deep Q-Networkcited by 2
- 2022Improve Generalization of Driving Policy at Signalized Intersections with Adversarial Learningcited by 2
- 2022Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discoverycited by 1
- 2023Review of Deep Reinforcement Learning for Autonomous Drivingcited by 1
- 2023Deep Q-Network Based Decision Making for Autonomous Driving21 Mar 2023
- 2023Review of Deep Reinforcement Learning for Autonomous Driving13 Feb 2023
- 2022Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery24 Jul 2022
- 2022State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections10 Jul 2022
- 2022Improve Generalization of Driving Policy at Signalized Intersections with Adversarial Learning9 Apr 2022
- 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Driving21 May 2021
- 2021Pedestrian Collision Avoidance for Autonomous Vehicles at Unsignalized Intersection Using Deep Q-Network1 May 2021
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learning5 Feb 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
- 2018OIL: Observational Imitation Learningcited by 11
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2018OIL: Observational Imitation Learning3 Mar 2018
- 2021Learning to Navigate Intersections with Unsupervised Driver Trait Inferencecited by 8
- 2021End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learningcited by 6
- 2021Experience-Based Heuristic Search: Robust Motion Planning with Deep Q-Learningcited by 4
- 2021Formulation and validation of a car-following model based on deep reinforcement learningcited by 4
- 2021Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learningcited by 3
- 2021Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersectioncited by 3
- 2021High-level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Mergingcited by 1
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learningcited by 1
- 2023Intersection Warning System for Occlusion Risks using Relational Local Dynamic Mapscited by 0
- 2023Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applicationscited by 0
- 2023Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applications9 Jun 2023
- 2023Intersection Warning System for Occlusion Risks using Relational Local Dynamic Maps13 Mar 2023
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning11 May 2022
- 2021Formulation and validation of a car-following model based on deep reinforcement learning29 Sep 2021
- 2021Learning to Navigate Intersections with Unsupervised Driver Trait Inference14 Sep 2021
- 2021High-level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Merging15 Jul 2021
- 2021Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersection8 Jun 2021
- 2021End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learning28 Apr 2021
- 2021Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learning12 Feb 2021
- 2021Experience-Based Heuristic Search: Robust Motion Planning with Deep Q-Learning5 Feb 2021