Safety Assurances for Human-Robot Interaction via Confidence-aware Game-theoretic Human Models
Not on the map. Why?
Abstract (arXiv)
An outstanding challenge with safety methods for human-robot interaction is reducing their conservatism while maintaining robustness to variations in human behavior. In this work, we propose that robots use confidence-aware game-theoretic models of human behavior when assessing the safety of a human-robot interaction. By treating the influence between the human and robot as well as the human's rationality as unobserved latent states, we succinctly infer the degree to which a human is following the game-theoretic interaction model. We leverage this model to restrict the set of feasible human controls during safety verification, enabling the robot to confidently modulate the conservatism of its safety monitor online. Evaluations in simulated human-robot scenarios and ablation studies demonstrate that imbuing safety monitors with confidence-aware game-theoretic models enables both safe and efficient human-robot interaction. Moreover, evaluations with real traffic data show that our safety monitor is less conservative than traditional safety methods in real human driving scenarios.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Sep 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 4; 2023: 8; 2024: 5; 2025: 4.
21 papers.
Sort:
By area:
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 88
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Drivingcited by 56
- 2023Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approachcited by 15
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehiclescited by 11
- 2023Towards Modeling and Influencing the Dynamics of Human Learningcited by 11
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 11
- 2022Active Uncertainty Reduction for Human-Robot Interaction: An Implicit Dual Control Approachcited by 10
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 10
- 2022Learning Differentiable Safety-Critical Control using Control Barrier Functions for Generalization to Novel Environmentscited by 9
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safetycited by 7
- 2025Predictive Planner for Autonomous Driving with Consistency Modelscited by 7
9 more
- 2024Blending Data-Driven Priors in Dynamic Gamescited by 6
- 2022Learning Latent Representations to Co-Adapt to Humanscited by 5
- 2025Socratic: Enhancing Human Teamwork via AI-enabled Coachingcited by 2
- 2023Bayesian inference for data-efficient, explainable, and safe robotic motion planning: A reviewcited by 1
- 2024Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robotscited by 1
- 2024Context-Based Echo State Networks with Prediction Confidence for Human-Robot Shared Controlcited by 1
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approachcited by 1
- 2023Learned Tree Search for Long-Horizon Social Robot Navigation in Shared Airspacecited by 0
- 2025Heterogeneous Decision Making in Mixed Traffic: Uncertainty-aware Planning and Bounded Rationalitycited by 0
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025Heterogeneous Decision Making in Mixed Traffic: Uncertainty-aware Planning and Bounded Rationality25 Feb 2025
- 2025Socratic: Enhancing Human Teamwork via AI-enabled Coaching24 Feb 2025
- 2025Predictive Planner for Autonomous Driving with Consistency Models12 Feb 2025
- 2024Context-Based Echo State Networks with Prediction Confidence for Human-Robot Shared Control30 Nov 2024
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving1 Jul 2024
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safety16 May 2024
- 2024Blending Data-Driven Priors in Dynamic Games21 Feb 2024
- 2024Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robots14 Feb 2024
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis14 Dec 2023
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions21 Nov 2023
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems11 Sep 2023
9 more
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy3 Sep 2023
- 2023Bayesian inference for data-efficient, explainable, and safe robotic motion planning: A review16 Jul 2023
- 2023Learned Tree Search for Long-Horizon Social Robot Navigation in Shared Airspace4 Apr 2023
- 2023Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approach1 Feb 2023
- 2023Towards Modeling and Influencing the Dynamics of Human Learning2 Jan 2023
- 2022Learning Latent Representations to Co-Adapt to Humans19 Dec 2022
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles25 Jul 2022
- 2022Active Uncertainty Reduction for Human-Robot Interaction: An Implicit Dual Control Approach15 Feb 2022
- 2022Learning Differentiable Safety-Critical Control using Control Barrier Functions for Generalization to Novel Environments4 Jan 2022
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 88
- 2023Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approachcited by 15
- 2023Towards Modeling and Influencing the Dynamics of Human Learningcited by 11
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 11
- 2022Active Uncertainty Reduction for Human-Robot Interaction: An Implicit Dual Control Approachcited by 10
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 10
- 2022Learning Differentiable Safety-Critical Control using Control Barrier Functions for Generalization to Novel Environmentscited by 9
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safetycited by 7
- 2024Blending Data-Driven Priors in Dynamic Gamescited by 6
- 2022Learning Latent Representations to Co-Adapt to Humanscited by 5
- 2025Socratic: Enhancing Human Teamwork via AI-enabled Coachingcited by 2
12 most cited of 17 All 17 (JSON)
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025Heterogeneous Decision Making in Mixed Traffic: Uncertainty-aware Planning and Bounded Rationality25 Feb 2025
- 2025Socratic: Enhancing Human Teamwork via AI-enabled Coaching24 Feb 2025
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safety16 May 2024
- 2024Blending Data-Driven Priors in Dynamic Games21 Feb 2024
- 2024Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robots14 Feb 2024
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis14 Dec 2023
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions21 Nov 2023
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems11 Sep 2023
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy3 Sep 2023
- 2023Bayesian inference for data-efficient, explainable, and safe robotic motion planning: A review16 Jul 2023
- 2023Learned Tree Search for Long-Horizon Social Robot Navigation in Shared Airspace4 Apr 2023
12 newest of 17 All 17 (JSON)