Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behavior
Not on the map. Why?
Abstract (arXiv)
There has been significant interest of late in generating behavior of agents that is interpretable to the human (observer) in the loop. However, the work in this area has typically lacked coherence on the topic, with proposed solutions for "explicable", "legible", "predictable" and "transparent" planning with overlapping, and sometimes conflicting, semantics all aimed at some notion of understanding what intentions the observer will ascribe to an agent by observing its behavior. This is also true for the recent works on "security" and "privacy" of plans which are also trying to answer the same question, but from the opposite point of view -- i.e. when the agent is trying to hide instead of revealing its intentions. This paper attempts to provide a workable taxonomy of relevant concepts in this exciting and emerging field of inquiry.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 7; 2022: 5; 2023: 5; 2024: 4; 2025: 5; 2026: 3.
30 papers.
Sort:
By area:
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2021Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recoverycited by 32
- 2024Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?cited by 22
- 2021Explainable Autonomous Robots: A Survey and Perspectivecited by 15
- 2021Deceptive Reinforcement Learning for Privacy-Preserving Planningcited by 14
- 2021Human-AI Symbiosis: A Survey of Current Approachescited by 8
- 2021Definitions of intent suitable for algorithmscited by 8
- 2019Motion Reasoning for Goal-Based Imitation Learningcited by 6
- 2021A Unifying Bayesian Formulation of Measures of Interpretability in Human-AIcited by 5
- 2022Explaining Preference-driven Schedules: the EXPRES Frameworkcited by 5
- 2022A Mental-Model Centric Landscape of Human-AI Symbiosiscited by 3
- 2022Policy Regularization for Legible Behaviorcited by 3
18 more
- 2021Generating Active Explicable Plans in Human-Robot Teamingcited by 2
- 2022Causal Explanations for Sequential Decision Making Under Uncertaintycited by 2
- 2022"Guess what I'm doing": Extending legibility to sequential decision taskscited by 2
- 2023Planning for Attacker Entrapment in Adversarial Settingscited by 1
- 2023Safe Explicable Planningcited by 1
- 2024On the Transit Obfuscation Problemcited by 1
- 2024Generalising Planning Environment Redesigncited by 1
- 2024How to Exhibit More Predictable Behaviorscited by 1
- 2023A More General Theory of Diagnosis from First Principlescited by 0
- 2023ICRA Roboethics Challenge 2023: Intelligent Disobedience in an Elderly Care Homecited by 0
- 2025Observer-Aware Probabilistic Planning Under Partial Observabilitycited by 0
- 2025Safe Explicable Policy Searchcited by 0
- 2025Preprint: Exploring Inevitable Waypoints for Unsolvability Explanation in Hybrid Planning Problemscited by 0
- 2025Controlling Intent Expressiveness in Robot Motion with Diffusion Modelscited by 0
- 2025Informative Communication of Robot Planscited by 0
- 2026Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localizationcited by 0
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behaviorcited by 0
- 2026Probabilistic Plan Legibility with Off-the-shelf Plannerscited by 0
- 2026Probabilistic Plan Legibility with Off-the-shelf Planners4 Sep 2026
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior4 Sep 2026
- 2026Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization4 Jun 2026
- 2025Informative Communication of Robot Plans17 Nov 2025
- 2025Controlling Intent Expressiveness in Robot Motion with Diffusion Models14 Oct 2025
- 2025Preprint: Exploring Inevitable Waypoints for Unsolvability Explanation in Hybrid Planning Problems22 Apr 2025
- 2025Safe Explicable Policy Search10 Mar 2025
- 2025Observer-Aware Probabilistic Planning Under Partial Observability14 Feb 2025
- 2024How to Exhibit More Predictable Behaviors17 Apr 2024
- 2024Generalising Planning Environment Redesign12 Feb 2024
- 2024On the Transit Obfuscation Problem12 Feb 2024
- 2024Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?10 Jan 2024
18 more
- 2023ICRA Roboethics Challenge 2023: Intelligent Disobedience in an Elderly Care Home15 Nov 2023
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions30 Oct 2023
- 2023A More General Theory of Diagnosis from First Principles28 Sep 2023
- 2023Safe Explicable Planning4 Apr 2023
- 2023Planning for Attacker Entrapment in Adversarial Settings1 Mar 2023
- 2022"Guess what I'm doing": Extending legibility to sequential decision tasks19 Sep 2022
- 2022Causal Explanations for Sequential Decision Making Under Uncertainty30 May 2022
- 2022Explaining Preference-driven Schedules: the EXPRES Framework16 Mar 2022
- 2022Policy Regularization for Legible Behavior8 Mar 2022
- 2022A Mental-Model Centric Landscape of Human-AI Symbiosis18 Feb 2022
- 2021Generating Active Explicable Plans in Human-Robot Teaming18 Sep 2021
- 2021Definitions of intent suitable for algorithms8 Jun 2021
- 2021Explainable Autonomous Robots: A Survey and Perspective6 May 2021
- 2021A Unifying Bayesian Formulation of Measures of Interpretability in Human-AI21 Apr 2021
- 2021Human-AI Symbiosis: A Survey of Current Approaches18 Mar 2021
- 2021Deceptive Reinforcement Learning for Privacy-Preserving Planning5 Feb 2021
- 2021Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recovery5 Jan 2021
- 2019Motion Reasoning for Goal-Based Imitation Learning13 Nov 2019
- 2019Motion Reasoning for Goal-Based Imitation Learningcited by 6
- 2019Motion Reasoning for Goal-Based Imitation Learning13 Nov 2019
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2021Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recoverycited by 32
- 2024Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?cited by 22
- 2021Explainable Autonomous Robots: A Survey and Perspectivecited by 15
- 2021Deceptive Reinforcement Learning for Privacy-Preserving Planningcited by 14
- 2021Human-AI Symbiosis: A Survey of Current Approachescited by 8
- 2021Definitions of intent suitable for algorithmscited by 8
- 2021A Unifying Bayesian Formulation of Measures of Interpretability in Human-AIcited by 5
- 2022Explaining Preference-driven Schedules: the EXPRES Frameworkcited by 5
- 2022A Mental-Model Centric Landscape of Human-AI Symbiosiscited by 3
- 2022Policy Regularization for Legible Behaviorcited by 3
- 2021Generating Active Explicable Plans in Human-Robot Teamingcited by 2
12 most cited of 27 All 27 (JSON)
- 2026Probabilistic Plan Legibility with Off-the-shelf Planners4 Sep 2026
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior4 Sep 2026
- 2026Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization4 Jun 2026
- 2025Informative Communication of Robot Plans17 Nov 2025
- 2025Preprint: Exploring Inevitable Waypoints for Unsolvability Explanation in Hybrid Planning Problems22 Apr 2025
- 2025Safe Explicable Policy Search10 Mar 2025
- 2025Observer-Aware Probabilistic Planning Under Partial Observability14 Feb 2025
- 2024How to Exhibit More Predictable Behaviors17 Apr 2024
- 2024Generalising Planning Environment Redesign12 Feb 2024
- 2024On the Transit Obfuscation Problem12 Feb 2024
- 2024Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?10 Jan 2024
- 2023ICRA Roboethics Challenge 2023: Intelligent Disobedience in an Elderly Care Home15 Nov 2023
12 newest of 27 All 27 (JSON)