Towards Computationally Efficient Responsibility Attribution in Decentralized Partially Observable MDPs
Not on the map. Why?
Abstract (arXiv)
Responsibility attribution is a key concept of accountable multi-agent decision making. Given a sequence of actions, responsibility attribution mechanisms quantify the impact of each participating agent to the final outcome. One such popular mechanism is based on actual causality, and it assigns (causal) responsibility based on the actions that were found to be pivotal for the considered outcome. However, the inherent problem of pinpointing actual causes and consequently determining the exact responsibility assignment has shown to be computationally intractable. In this paper, we aim to provide a practical algorithmic solution to the problem of responsibility attribution under a computational budget. We first formalize the problem in the framework of Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) augmented by a specific class of Structural Causal Models (SCMs). Under this framework, we introduce a Monte Carlo Tree Search (MCTS) type of method which efficiently approximates the agents' degrees of responsibility. This method utilizes the structure of a novel search tree and a pruning technique, both tailored to the problem of responsibility attribution. Other novel components of our method are (a) a child selection policy based on linear scalarization and (b) a backpropagation procedure that accounts for a minimality condition that is typically used to define actual causality. We experimentally evaluate the efficacy of our algorithm through a simulation-based test-bed, which includes three team-based card games.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 54 references that are in the map. First posted on arXiv 24 Feb 2023.
Builds on
19 of 54 references.
References · 19
- 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 781
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 225
- 2019OpenSpiel: A Framework for Reinforcement Learning in Gamescited by 180
- 2019Counterfactual Off-Policy Evaluation with Gumbel-Max Structural Causal Modelscited by 114
- 2018Woulda, Coulda, Shoulda: Counterfactually-Guided Policy Searchcited by 81
- 2015A Modification of the Halpern-Pearl Definition of Causalitycited by 47
- 2021Counterfactual Explanations in Sequential Decision Making Under Uncertaintycited by 36
- 2018Towards Formal Definitions of Blameworthiness, Intention, and Moral Responsibilitycited by 32
- 2020Synthesizing Tasks for Block-based Programmingcited by 19
- 2021Learning Generalized Gumbel-max Causal Mechanismscited by 16
- 2021A Game-Theoretic Account of Responsibility Allocationcited by 15
- 2017Multi-objective Contextual Multi-armed Bandit with a Dominant Objectivecited by 14
7 more
- 2021On Blame Attribution for Accountable Multi-Agent Sequential Decision Makingcited by 13
- 2014The Computational Complexity of Structure-Based Causalitycited by 12
- 2019Blameworthiness in Multi-Agent Settingscited by 11
- 2022Multi-Agent Reinforcement Learning for Traffic Signal Control through Universal Communication Methodcited by 10
- 2020Causality, Responsibility and Blame in Team Planscited by 9
- 2022Actual Causality and Responsibility Attribution in Decentralized Partially Observable Markov Decision Processescited by 8
- 2019Bidding in Spadescited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1.
3 papers.
- 2023Agent-Specific Effects: A Causal Effect Propagation Analysis in Multi-Agent MDPscited by 1
- 2024Extending Structural Causal Models for Autonomous Vehicles to Simplify Temporal System Construction & Enable Dynamic Interactions Between Agentscited by 1
- 2025Generating Causal Explanations of Vehicular Agent Behavioural Interactions with Learnt Reward Profilescited by 0
- 2025Generating Causal Explanations of Vehicular Agent Behavioural Interactions with Learnt Reward Profiles18 Mar 2025
- 2024Extending Structural Causal Models for Autonomous Vehicles to Simplify Temporal System Construction & Enable Dynamic Interactions Between Agents3 Jun 2024
- 2023Agent-Specific Effects: A Causal Effect Propagation Analysis in Multi-Agent MDPs17 Oct 2023