Explainable Autonomous Robots: A Survey and Perspective
Not on the map. Why?
Abstract (arXiv)
Advanced communication protocols are critical to enable the coexistence of autonomous robots with humans. Thus, the development of explanatory capabilities is an urgent first step toward autonomous robots. This survey provides an overview of the various types of "explainability" discussed in machine learning research. Then, we discuss the definition of "explainability" in the context of autonomous robots (i.e., explainable autonomous robots) by exploring the question "what is an explanation?" We further conduct a research survey based on this definition and present some relevant topics for future research.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 30 of its 94 references that are in the map. First posted on arXiv 6 May 2021.
Builds on
30 of 94 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 206
- 2018Programmatically Interpretable Reinforcement Learningcited by 193
- 2019Explainable Reinforcement Learning Through a Causal Lenscited by 177
- 2020Explainable Reinforcement Learning: A Surveycited by 141
18 more
- 2018State Representation Learning for Control: An Overviewcited by 127
- 2019Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptionscited by 81
- 2020World Model as a Graph: Learning Latent Landmarks for Planningcited by 69
- 2019Interestingness Elements for Explainable Reinforcement Learning: Understanding Agents' Capabilities and Limitationscited by 50
- 2017Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathycited by 44
- 2018Contrastive Explanations for Reinforcement Learning in terms of Expected Consequencescited by 44
- 2020The Emerging Landscape of Explainable AI Planning and Decision Makingcited by 44
- 2018Learning Finite State Representations of Recurrent Policy Networkscited by 37
- 2017Enabling Robots to Communicate their Objectivescited by 35
- 2019Explainability in Human-Agent Systemscited by 34
- 2021Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recoverycited by 32
- 2015Symbol Emergence in Robotics: A Surveycited by 31
- 2018Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behaviorcited by 30
- 2020Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Taskscited by 15
- 2020Distal Explanations for Model-free Explainable Reinforcement Learningcited by 12
- 2018Autonomous Self-Explanation of Behavior for Interactive Reinforcement Learning Agentscited by 10
- 2020Designing Environments Conducive to Interpretable Robot Behaviorcited by 8
- 2020Sequential Explanations with Mental Model-Based Policiescited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 6; 2025: 5; 2026: 1.
15 papers.
Sort:
By area:
- 2024Trust in AI: Progress, Challenges, and Future Directionscited by 35
- 2022DreamingV2: Reinforcement Learning with Discrete World Models without Reconstructioncited by 29
- 2025Episodic memory in AI agents poses risks that should be studied and mitigatedcited by 11
- 2024Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regressioncited by 5
- 2022Explain yourself! Effects of Explanations in Human-Robot Interactioncited by 2
- 2024Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Modelscited by 2
- 2023Modifying RL Policies with Imagined Actions: How Predictable Policies Can Enable Users to Perform Novel Taskscited by 1
- 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDTcited by 0
- 2024Imagining In-distribution States: How Predictable Robot Behavior Can Enable User Control Over Learned Policiescited by 0
- 2024Enhancing Robot Assistive Behaviour with Reinforcement Learning and Theory of Mindcited by 0
- 2025Joint Action Language Modelling for Transparent Policy Executioncited by 0
- 2025Effective Explanations for Belief-Desire-Intention Robots: When and What to Explaincited by 0
3 more
- 2025From Facts to Foils: Designing and Evaluating Counterfactual Explanations for Smart Environmentscited by 0
- 2025Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferencescited by 0
- 2026PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulationcited by 0
- 2026PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation17 Sep 2026
- 2025Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferences31 Dec 2025
- 2025From Facts to Foils: Designing and Evaluating Counterfactual Explanations for Smart Environments3 Oct 2025
- 2025Effective Explanations for Belief-Desire-Intention Robots: When and What to Explain2 Jul 2025
- 2025Joint Action Language Modelling for Transparent Policy Execution14 Apr 2025
- 2025Episodic memory in AI agents poses risks that should be studied and mitigated20 Jan 2025
- 2024Enhancing Robot Assistive Behaviour with Reinforcement Learning and Theory of Mind11 Nov 2024
- 2024Imagining In-distribution States: How Predictable Robot Behavior Can Enable User Control Over Learned Policies19 Jun 2024
- 2024Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regression21 Mar 2024
- 2024Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Models14 Mar 2024
- 2024Trust in AI: Progress, Challenges, and Future Directions12 Mar 2024
- 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDT13 Feb 2024
3 more
- 2023Modifying RL Policies with Imagined Actions: How Predictable Policies Can Enable Users to Perform Novel Tasks10 Dec 2023
- 2022Explain yourself! Effects of Explanations in Human-Robot Interaction9 Apr 2022
- 2022DreamingV2: Reinforcement Learning with Discrete World Models without Reconstruction1 Mar 2022
- 2024Trust in AI: Progress, Challenges, and Future Directionscited by 35
- 2025Episodic memory in AI agents poses risks that should be studied and mitigatedcited by 11
- 2022Explain yourself! Effects of Explanations in Human-Robot Interactioncited by 2
- 2023Modifying RL Policies with Imagined Actions: How Predictable Policies Can Enable Users to Perform Novel Taskscited by 1
- 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDTcited by 0
- 2024Imagining In-distribution States: How Predictable Robot Behavior Can Enable User Control Over Learned Policiescited by 0
- 2025Joint Action Language Modelling for Transparent Policy Executioncited by 0
- 2025Effective Explanations for Belief-Desire-Intention Robots: When and What to Explaincited by 0
- 2025From Facts to Foils: Designing and Evaluating Counterfactual Explanations for Smart Environmentscited by 0
- 2025Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferencescited by 0
- 2026PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulationcited by 0
- 2026PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation17 Sep 2026
- 2025Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferences31 Dec 2025
- 2025From Facts to Foils: Designing and Evaluating Counterfactual Explanations for Smart Environments3 Oct 2025
- 2025Effective Explanations for Belief-Desire-Intention Robots: When and What to Explain2 Jul 2025
- 2025Joint Action Language Modelling for Transparent Policy Execution14 Apr 2025
- 2025Episodic memory in AI agents poses risks that should be studied and mitigated20 Jan 2025
- 2024Imagining In-distribution States: How Predictable Robot Behavior Can Enable User Control Over Learned Policies19 Jun 2024
- 2024Trust in AI: Progress, Challenges, and Future Directions12 Mar 2024
- 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDT13 Feb 2024
- 2023Modifying RL Policies with Imagined Actions: How Predictable Policies Can Enable Users to Perform Novel Tasks10 Dec 2023
- 2022Explain yourself! Effects of Explanations in Human-Robot Interaction9 Apr 2022