mlsanityData to 7 Oct 2026

Reinforcement Learning with Uncertainty Estimation for Tactical Decision-Making in Intersections

arXiv 2006.09786 ↗First posted 17 Jun 2020cs.RO cs.AI cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

This paper investigates how a Bayesian reinforcement learning method can be used to create a tactical decision-making agent for autonomous driving in an intersection scenario, where the agent can estimate the confidence of its recommended actions. An ensemble of neural networks, with additional randomized prior functions (RPF), are trained by using a bootstrapped experience replay memory. The coefficient of variation in the estimated Q-values of the ensemble members is used to approximate the uncertainty, and a criterion that determines if the agent is sufficiently confident to make a particular decision is introduced. The performance of the ensemble RPF method is evaluated in an intersection scenario, and compared to a standard Deep Q-Network method. It is shown that the trained ensemble RPF agent can detect cases with high uncertainty, both in situations that are far from the training distribution, and in situations that seldom occur within the training distribution. In this study, the uncertainty information is used to choose safe actions in unknown situations, which removes all collisions from within the training distribution, and most collisions outside of the distribution.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 3; 2022: 4; 2023: 1; 2024: 5; 2025: 2.

15 papers.

Sort:

By area:

  1. 2021Uncertainty Weighted Actor-Critic for Offline Reinforcement Learningcited by 125
  2. 2021Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning with Applications in Autonomous Drivingcited by 17
  3. 2022State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersectionscited by 15
  4. 2021Decision-Making Technology for Autonomous Vehicles Learning-Based Methods, Applications and Future Outlookcited by 14
  5. 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutionscited by 7
  6. 2023Identify, Estimate and Bound the Uncertainty of Reinforcement Learning for Autonomous Drivingcited by 6
  7. 2022How to Learn from Risk: Explicit Risk-Utility Reinforcement Learning for Efficient and Safe Driving Strategiescited by 4
  8. 2024Contextualized Hybrid Ensemble Q-learning: Learning Fast with Control Priorscited by 4
  9. 2022Influence of uncertainty estimation techniques on false-positive reduction in liver lesion detectioncited by 3
  10. 2022Graph Convolution-Based Deep Reinforcement Learning for Multi-Agent Decision-Making in Mixed Traffic Environmentscited by 1
  11. 2024Grid-Mapping Pseudo-Count Constraint for Offline Reinforcement Learningcited by 1
  12. 2024Stepping Out of the Shadows: Reinforcement Learning in Shadow Modecited by 1
3 more
  1. 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Surveycited by 1
  2. 2024GITSR: Graph Interaction Transformer-based Scene Representation for Multi Vehicle Collaborative Decision-makingcited by 0
  3. 2025UAMDP: Uncertainty-Aware Markov Decision Process for Risk-Constrained Reinforcement Learning from Probabilistic Forecastscited by 0