Autonomous Vehicle Decision-Making Framework for Considering Malicious Behavior at Unsignalized Intersections
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a Q-learning based decision-making framework to improve the safety and efficiency of Autonomous Vehicles when they encounter other maliciously behaving vehicles while passing through unsignalized intersections. In Autonomous Vehicles, conventional reward signals are set as regular rewards regarding feedback factors such as safety and efficiency. In this paper, safety gains are modulated by variable weighting parameters to ensure that safety can be emphasized more in emergency situations. The framework proposed in this paper introduces first-order theory of mind inferences on top of conventional rewards, using first-order beliefs as additional reward signals. The decision framework enables Autonomous Vehicles to make informed decisions when encountering vehicles with potentially malicious behaviors at unsignalized intersections, thereby improving the overall safety and efficiency of Autonomous Vehicle transportation systems. In order to verify the performance of the decision framework, this paper uses Prescan/Simulink co-simulations for simulation, and the results show that the performance of the decision framework can meet the set requirements.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 39 references that are in the map. First posted on arXiv 11 Sep 2024.
Builds on
12 of 39 references.
References · 12
- 2023Reward Design with Language Modelscited by 261
- 2013Risk-sensitive Reinforcement Learningcited by 130
- 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
- 2020Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approachcited by 31
- 2023Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learningcited by 19
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awarenesscited by 12
- 2021Theory of Mind for Deep Reinforcement Learning in Hanabicited by 11
- 2019Cooperative Driving at Unsignalized Intersections Using Tree Searchcited by 10
- 2019Game-theoretic Modeling of Traffic in Unsignalized Intersection Network for Autonomous Vehicle Control Verification and Validationcited by 8
- 2019Decision Making for Autonomous Vehicles at Unsignalized Intersection in Presence of Malicious Vehiclescited by 6
- 2024Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentarycited by 3
- 2021Cooperation Method of Connected and Automated Vehicles at Unsignalized Intersections: Lane Changing and Arrival Schedulingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Uncertainty-Aware Safety-Critical Decision and Control for Autonomous Vehicles at Unsignalized Intersections
- 2025Toward Safety-First Human-Like Decision Making for Autonomous Vehicles in Time-Varying Traffic Flow
- 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions
- 2023ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events
- 2026A Risk-Sensitive and Uncertainty-Aware Decision-Making and Control Framework for Safe and Robust Autonomous Driving
- 2024SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Models
- 2021Don't Get Yourself into Trouble! Risk-aware Decision-Making for Autonomous Vehicles
- 2025Risk-Aware Reinforcement Learning for Autonomous Driving: Improving Safety When Driving through Intersection