# Towards Formal Definitions of Blameworthiness, Intention, and Moral Responsibility

arXiv: https://arxiv.org/abs/1810.05903 · HTML: https://mlsanity.com/paper/1810.05903/

## Key facts

- Cited by 32 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Oct 2018.

## Built on by (most cited first, 30 of 32)

- [AI Sandbagging: Language Models can Strategically Underperform on Evaluations](https://mlsanity.com/paper/2406.07358/) (2024)
- [Robust agents learn causal world models](https://mlsanity.com/paper/2402.10877/) (2024)
- [Honesty Is the Best Policy: Defining and Mitigating AI Deception](https://mlsanity.com/paper/2312.01350/) (2023)
- [AI Alignment with Changing and Influenceable Reward Functions](https://mlsanity.com/paper/2405.17713/) (2024)
- [Counterfactual harm](https://mlsanity.com/paper/2204.12993/) (2022)
- [Discovering Agents](https://mlsanity.com/paper/2208.08345/) (2022)
- [Path-Specific Objectives for Safer Agent Incentives](https://mlsanity.com/paper/2204.10018/) (2022)
- [Reasoning about Causality in Games](https://mlsanity.com/paper/2301.02324/) (2023)
- [Partial Counterfactual Identification of Continuous Outcomes with a Curvature Sensitivity Model](https://mlsanity.com/paper/2306.01424/) (2023)
- [On Blame Attribution for Accountable Multi-Agent Sequential Decision Making](https://mlsanity.com/paper/2107.11927/) (2021)
- [Human Control: Definitions and Algorithms](https://mlsanity.com/paper/2305.19861/) (2023)
- [Definitions of intent suitable for algorithms](https://mlsanity.com/paper/2106.04235/) (2021)
- [Actual Causality and Responsibility Attribution in Decentralized Partially Observable Markov Decision Processes](https://mlsanity.com/paper/2204.00302/) (2022)
- [Measuring Goal-Directedness](https://mlsanity.com/paper/2412.04758/) (2024)
- [Anticipating Responsibility in Multiagent Planning](https://mlsanity.com/paper/2307.16685/) (2023)
- [Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Making](https://mlsanity.com/paper/2410.12539/) (2024)
- [Towards Computationally Efficient Responsibility Attribution in Decentralized Partially Observable MDPs](https://mlsanity.com/paper/2302.12676/) (2023)
- [Extending counterfactual accounts of intent to include oblique intent](https://mlsanity.com/paper/2106.03684/) (2021)
- [Analyzing Intentional Behavior in Autonomous Agents under Uncertainty](https://mlsanity.com/paper/2307.01532/) (2023)
- [Causal Responsibility Attribution for Human-AI Collaboration](https://mlsanity.com/paper/2411.03275/) (2024)
- [Who Gets Credit or Blame? Attributing Accountability in Modern AI Systems](https://mlsanity.com/paper/2506.00175/) (2025)
- [Learning "Partner-Aware" Collaborators in Multi-Party Collaboration](https://mlsanity.com/paper/2510.22462/) (2025)
- [Counterfactual Reasoning for Causal Responsibility Attribution in Probabilistic Multi-Agent Systems](https://mlsanity.com/paper/2605.13077/) (2026)
- [Moral reinforcement learning using actual causation](https://mlsanity.com/paper/2205.08192/) (2022)
- [Toward A Logical Theory Of Fairness and Bias](https://mlsanity.com/paper/2306.13659/) (2023)
- [Agent-Specific Effects: A Causal Effect Propagation Analysis in Multi-Agent MDPs](https://mlsanity.com/paper/2310.11334/) (2023)
- [Utility Functions for Human/Robot Interaction](https://mlsanity.com/paper/2204.04071/) (2022)
- [Experiments with Detecting and Mitigating AI Deception](https://mlsanity.com/paper/2306.14816/) (2023)
- [Causal Kripke Models](https://mlsanity.com/paper/2307.05631/) (2023)
- [The Benefits of Power Regularization in Cooperative Reinforcement Learning](https://mlsanity.com/paper/2406.11240/) (2024)

## Abstract (arXiv)

We provide formal definitions of degree of blameworthiness and intention relative to an epistemic state (a probability over causal models and a utility function on outcomes). These, together with a definition of actual causality, provide the key ingredients for moral responsibility judgments. We show that these definitions give insight into commonsense intuitions in a variety of puzzling cases from the literature.