mlsanityData to 7 Oct 2026

Towards Computationally Efficient Responsibility Attribution in Decentralized Partially Observable MDPs

arXiv 2302.12676 ↗First posted 24 Feb 2023cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Responsibility attribution is a key concept of accountable multi-agent decision making. Given a sequence of actions, responsibility attribution mechanisms quantify the impact of each participating agent to the final outcome. One such popular mechanism is based on actual causality, and it assigns (causal) responsibility based on the actions that were found to be pivotal for the considered outcome. However, the inherent problem of pinpointing actual causes and consequently determining the exact responsibility assignment has shown to be computationally intractable. In this paper, we aim to provide a practical algorithmic solution to the problem of responsibility attribution under a computational budget. We first formalize the problem in the framework of Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) augmented by a specific class of Structural Causal Models (SCMs). Under this framework, we introduce a Monte Carlo Tree Search (MCTS) type of method which efficiently approximates the agents' degrees of responsibility. This method utilizes the structure of a novel search tree and a pruning technique, both tailored to the problem of responsibility attribution. Other novel components of our method are (a) a child selection policy based on linear scalarization and (b) a backpropagation procedure that accounts for a minimality condition that is typically used to define actual causality. We experimentally evaluate the efficacy of our algorithm through a simulation-based test-bed, which includes three team-based card games.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 54 references that are in the map. First posted on arXiv 24 Feb 2023.

Builds on

19 of 54 references.

References · 19

  1. 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 781
  2. 2013The Complexity of Decentralized Control of Markov Decision Processescited by 225
  3. 2019OpenSpiel: A Framework for Reinforcement Learning in Gamescited by 180
  4. 2019Counterfactual Off-Policy Evaluation with Gumbel-Max Structural Causal Modelscited by 114
  5. 2018Woulda, Coulda, Shoulda: Counterfactually-Guided Policy Searchcited by 81
  6. 2015A Modification of the Halpern-Pearl Definition of Causalitycited by 47
  7. 2021Counterfactual Explanations in Sequential Decision Making Under Uncertaintycited by 36
  8. 2018Towards Formal Definitions of Blameworthiness, Intention, and Moral Responsibilitycited by 32
  9. 2020Synthesizing Tasks for Block-based Programmingcited by 19
  10. 2021Learning Generalized Gumbel-max Causal Mechanismscited by 16
  11. 2021A Game-Theoretic Account of Responsibility Allocationcited by 15
  12. 2017Multi-objective Contextual Multi-armed Bandit with a Dominant Objectivecited by 14
7 more
  1. 2021On Blame Attribution for Accountable Multi-Agent Sequential Decision Makingcited by 13
  2. 2014The Computational Complexity of Structure-Based Causalitycited by 12
  3. 2019Blameworthiness in Multi-Agent Settingscited by 11
  4. 2022Multi-Agent Reinforcement Learning for Traffic Signal Control through Universal Communication Methodcited by 10
  5. 2020Causality, Responsibility and Blame in Team Planscited by 9
  6. 2022Actual Causality and Responsibility Attribution in Decentralized Partially Observable Markov Decision Processescited by 8
  7. 2019Bidding in Spadescited by 5

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 1.

3 papers.