A Unifying Bayesian Formulation of Measures of Interpretability in Human-AI
Not on the map. Why?
Abstract (arXiv)
Existing approaches for generating human-aware agent behaviors have considered different measures of interpretability in isolation. Further, these measures have been studied under differing assumptions, thus precluding the possibility of designing a single framework that captures these measures under the same assumptions. In this paper, we present a unifying Bayesian framework that models a human observer's evolving beliefs about an agent and thereby define the problem of Generalized Human-Aware Planning. We will show that the definitions of interpretability measures like explicability, legibility and predictability from the prior literature fall out as special cases of our general framework. Through this framework, we also bring a previously ignored fact to light that the human-robot interactions are in effect open-world problems, particularly as a result of modeling the human's beliefs over the agent. Since the human may not only hold beliefs unknown to the agent but may also form new hypotheses about the agent when presented with novel or unexpected behaviors.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 10 of its 38 references that are in the map. First posted on arXiv 21 Apr 2021.
Builds on
10 of 38 references.
References · 10
- 2018Where Do You Think You're Going?: Inferring Beliefs about Dynamics from Behaviorcited by 40
- 2018Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behaviorcited by 30
- 2018Probabilistically Safe Robot Planning with Confidence-Based Human Predictionscited by 27
- 2015Plan Explicability and Predictability for Robot Task Planningcited by 26
- 2018A Unified Framework for Planning in Adversarial and Cooperative Environmentscited by 15
- 2019Signaling Friends and Head-Faking Enemies Simultaneously: Balancing Goal Obfuscation and Goal Legibilitycited by 9
- 2019Expectation-Aware Planning: A Unifying Framework for Synthesizing and Executing Self-Explaining Plans for Human-Aware Planningcited by 8
- 2020Designing Environments Conducive to Interpretable Robot Behaviorcited by 8
- 2017Robot Planning with Mathematical Models of Human State and Actioncited by 7
- 2020A Bayesian Account of Measures of Interpretability in Human-AI Interactioncited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 1; 2025: 0; 2026: 1.
5 papers.
- 2021Deceptive Decision-Making Under Uncertaintycited by 8
- 2022A Mental-Model Centric Landscape of Human-AI Symbiosiscited by 3
- 2023Planning for Attacker Entrapment in Adversarial Settingscited by 1
- 2024Human-Modeling in Sequential Decision-Making: An Analysis through the Lens of Human-Aware AIcited by 0
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behaviorcited by 0
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior4 Sep 2026
- 2024Human-Modeling in Sequential Decision-Making: An Analysis through the Lens of Human-Aware AI13 May 2024
- 2023Planning for Attacker Entrapment in Adversarial Settings1 Mar 2023
- 2022A Mental-Model Centric Landscape of Human-AI Symbiosis18 Feb 2022
- 2021Deceptive Decision-Making Under Uncertainty14 Sep 2021