Building Interpretable Models for Moral Decision-Making
Not on the map. Why?
Abstract (arXiv)
We build a custom transformer model to study how neural networks make moral decisions on trolley-style dilemmas. The model processes structured scenarios using embeddings that encode who is affected, how many people, and which outcome they belong to. Our 2-layer architecture achieves 77% accuracy on Moral Machine data while remaining small enough for detailed analysis. We use different interpretability techniques to uncover how moral reasoning distributes across the network, demonstrating that biases localize to distinct computational stages among other findings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 11 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
7 of 11 references.
References · 7
- 2020Aligning AI With Shared Human Valuescited by 706
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
- 2020DoWhy: An End-to-End Library for Causal Inferencecited by 92
- 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
- 2023Uncovering Intermediate Variables in Transformers using Circuit Probingcited by 12
- 2024Large-scale moral machine experiment on large language modelscited by 9
Built on by
Not cited yet.