A Computational Model of Commonsense Moral Decision Making
Not on the map. Why?
Abstract (arXiv)
We introduce a new computational model of moral decision making, drawing on a recent theory of commonsense moral learning via social dynamics. Our model describes moral dilemmas as a utility function that computes trade-offs in values over abstract moral dimensions, which provide interpretable parameter values when implemented in machine-led ethical decision-making. Moreover, characterizing the social structures of individuals and groups as a hierarchical Bayesian model, we show that a useful description of an individual's moral values - as well as a group's shared values - can be inferred from a limited amount of observed data. Finally, we apply and evaluate our approach to data from the Moral Machine, a web application that collects human judgments on moral dilemmas involving autonomous vehicles.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 3; 2025: 2; 2026: 2.
13 papers.
Sort:
By area:
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
- 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
- 2024Beyond Preferences in AI Alignmentcited by 46
- 2023Proportional Aggregation of Preferences for Sequential Decision Makingcited by 17
- 2025Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisionscited by 9
- 2022Moral Dilemmas for Moral Machinescited by 6
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2022When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Datacited by 5
- 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunitiescited by 5
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AIcited by 5
- 2025Towards Cognitively-Faithful Decision-Making Models to Improve AI Alignmentcited by 2
- 2026The End Justifies the Mean: A Linear Ranking Rule for Proportional Sequential Decisionscited by 0
1 more
- 2026Position: We Need Practical AI Alignment Methods to Mirror Human Reasoning20 Jul 2026
- 2026The End Justifies the Mean: A Linear Ranking Rule for Proportional Sequential Decisions12 May 2026
- 2025Towards Cognitively-Faithful Decision-Making Models to Improve AI Alignment4 Sep 2025
- 2025Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisions2 Mar 2025
- 2024Beyond Preferences in AI Alignment30 Aug 2024
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities22 Aug 2024
- 2024Language Model Alignment in Multilingual Trolley Problems2 Jul 2024
- 2023Proportional Aggregation of Preferences for Sequential Decision Making26 Jun 2023
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AI10 Feb 2023
- 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities13 Jan 2023
- 2022Moral Dilemmas for Moral Machines11 Mar 2022
- 2022When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data19 Jan 2022
1 more
- 2021Can Machines Learn Morality? The Delphi Experiment14 Oct 2021
- 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
- 2024Beyond Preferences in AI Alignmentcited by 46
- 2024Beyond Preferences in AI Alignment30 Aug 2024
- 2024Language Model Alignment in Multilingual Trolley Problems2 Jul 2024
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
- 2023Proportional Aggregation of Preferences for Sequential Decision Makingcited by 17
- 2025Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisionscited by 9
- 2022Moral Dilemmas for Moral Machinescited by 6
- 2022When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Datacited by 5
- 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunitiescited by 5
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AIcited by 5
- 2025Towards Cognitively-Faithful Decision-Making Models to Improve AI Alignmentcited by 2
- 2026The End Justifies the Mean: A Linear Ranking Rule for Proportional Sequential Decisionscited by 0
- 2026Position: We Need Practical AI Alignment Methods to Mirror Human Reasoningcited by 0
- 2026Position: We Need Practical AI Alignment Methods to Mirror Human Reasoning20 Jul 2026
- 2026The End Justifies the Mean: A Linear Ranking Rule for Proportional Sequential Decisions12 May 2026
- 2025Towards Cognitively-Faithful Decision-Making Models to Improve AI Alignment4 Sep 2025
- 2025Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisions2 Mar 2025
- 2023Proportional Aggregation of Preferences for Sequential Decision Making26 Jun 2023
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AI10 Feb 2023
- 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities13 Jan 2023
- 2022Moral Dilemmas for Moral Machines11 Mar 2022
- 2022When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data19 Jan 2022
- 2021Can Machines Learn Morality? The Delphi Experiment14 Oct 2021