mlsanityData to 14 Oct 2026

Towards Theory-based Moral AI: Moral AI with Aggregating Models Based on Normative Ethical Theory

arXiv 2306.11432 ↗First posted 20 Jun 2023cs.AI cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Moral AI has been studied in the fields of philosophy and artificial intelligence. Although most existing studies are only theoretical, recent developments in AI have made it increasingly necessary to implement AI with morality. On the other hand, humans are under the moral uncertainty of not knowing what is morally right. In this paper, we implement the Maximizing Expected Choiceworthiness (MEC) algorithm, which aggregates outputs of models based on three normative theories of normative ethics to generate the most appropriate output. MEC is a method for making appropriate moral judgments under moral uncertainty. Our experimental results suggest that the output of MEC correlates to some extent with commonsense morality and that MEC can produce equally or more appropriate output than existing methods.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 20 Jun 2023.

Builds on

17 of 35 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  8. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  10. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
  11. 2020Aligning AI With Shared Human Valuescited by 723
  12. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 255
5 more
  1. 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
  2. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135
  3. 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
  4. 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
  5. 2022Towards Answering Open-ended Ethical Quandary Questionscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 4; 2026: 1.

8 papers.

  1. 2025The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmascited by 12
  2. 2023An Evaluation of GPT-4 on the ETHICS Datasetcited by 6
  3. 2025Histoires Morales: A French Dataset for Assessing Moral Alignmentcited by 4
  4. 2024Intuitions of Compromise: Utilitarianism vs. Contractualismcited by 1
  5. 2025Explainable Ethical Assessment on Human Behaviors by Generating Conflicting Social Normscited by 1
  6. 2024ClarityEthic: Explainable Moral Judgment Utilizing Contrastive Ethical Insights from Large Language Modelscited by 0
  7. 2025Probabilistic Aggregation and Targeted Embedding Optimization for Collective Moral Reasoning in Large Language Modelscited by 0
  8. 2026Bounded Morality: Defining the Space of Moral Computationcited by 0