Bounded Morality: Defining the Space of Moral Computation
Not on the map. Why?
Abstract (arXiv)
Moral cognition has traditionally been modeled as adherence to fixed ethical theories--deontology, consequentialism, virtue ethics--implemented as static rules or value functions. We propose Bounded Morality, a formal framework for analyzing the computational demands of moral problems faced by finite agents. Extending Herbert Simon's notion of bounded rationality, we formalize moral situations along two orthogonal dimensions: moral breadth, the scope of entities treated as morally relevant, and moral depth, the inferential integration required to evaluate their interactions. Limited resources impose an unavoidable tradeoff between these dimensions, defining a feasible space of moral computation. Within this space, ethical theories correspond to locally efficient strategies adapted to different demand regimes rather than competing accounts of moral truth. The framework yields a formal notion of moral regret and moral progress under constraint, and implies that moral alignment in artificial systems depends on the scaling and allocation of moral reasoning capacity rather than on direct imitation of human judgments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 45 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
5 of 45 references.
References · 5
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2024Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedbackcited by 95
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
- 2023Towards Theory-based Moral AI: Moral AI with Aggregating Models Based on Normative Ethical Theorycited by 8
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
Built on by
Not cited yet.