mlsanityData to 7 Oct 2026

Why did I fail? A Causal-based Method to Find Explanations for Robot Failures

arXiv 2204.04483 ↗First posted 9 Apr 2022cs.RO cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Robot failures in human-centered environments are inevitable. Therefore, the ability of robots to explain such failures is paramount for interacting with humans to increase trust and transparency. To achieve this skill, the main challenges addressed in this paper are I) acquiring enough data to learn a cause-effect model of the environment and II) generating causal explanations based on that model. We address I) by learning a causal Bayesian network from simulation data. Concerning II), we propose a novel method that enables robots to generate contrastive explanations upon task failures. The explanation is based on setting the failure state in contrast with the closest state that would have allowed for a successful execution. This state is found through breadth-first search and is based on success predictions from the learned causal model. We assessed our method in two different scenarios I) stacking cubes and II) dropping spheres into a container. The obtained causal models reach a sim2real accuracy of 70% and 72%, respectively. We finally show that our novel method scales over multiple tasks and allows real robots to give failure explanations like 'the upper cube was stacked too high and too far to the right of the lower cube.'

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 9 Apr 2022.

Builds on

13 of 31 references.

References · 13

  1. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  2. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
  3. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 413
  4. 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
  5. 2020The Emerging Landscape of Explainable AI Planning and Decision Makingcited by 44
  6. 2021Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recoverycited by 32
  7. 2021Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policiescited by 20
  8. 2021DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptionscited by 20
  9. 2020Review of The Book of Why: The New Science of Cause and Effectcited by 19
  10. 2021Semantic-Based Explainable AI: Leveraging Semantic Scene Graphs and Pairwise Ranking to Explain Robot Failurescited by 12
  11. 2015Learning Discrete Bayesian Networks from Continuous Datacited by 6
  12. 2021Work in Progress -- Automated Generation of Robotic Planning Domains from Observationscited by 2
1 more
  1. 2021Ontology-Assisted Generalisation of Robot Action Execution Knowledgecited by 2

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 4; 2025: 7.

13 papers.

Sort:

By area: