Probing Ethical Framework Representations in Large Language Models: Structure, Entanglement, and Methodological Challenges
Not on the map. Why?
Abstract (arXiv)
When large language models make ethical judgments, do their internal representations distinguish between normative frameworks, or collapse ethics into a single acceptability dimension? We probe hidden representations across five ethical frameworks (deontology, utilitarianism, virtue, justice, commonsense) in six LLMs spanning 4B--72B parameters. Our analysis reveals differentiated ethical subspaces with asymmetric transfer patterns -- e.g., deontology probes partially generalize to virtue scenarios while commonsense probes fail catastrophically on justice. Disagreement between deontological and utilitarian probes correlates with higher behavioral entropy across architectures, though this relationship may partly reflect shared sensitivity to scenario difficulty. Post-hoc validation reveals that probes partially depend on surface features of benchmark templates, motivating cautious interpretation. We discuss both the structural insights these methods provide and their epistemological limitations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
17 of 40 references.
References · 17
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2020Aligning AI With Shared Human Valuescited by 706
- 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 522
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2017What do Neural Machine Translation Models Learn about Morphology?cited by 165
- 2022DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answeringcited by 93
- 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 92
- 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 71
5 more
- 2023Probing the Moral Development of Large Language Models through Defining Issues Testcited by 23
- 2024Exploring and steering the moral compass of Large Language Modelscited by 15
- 2023Unsupervised Contrast-Consistent Ranking with Language Modelscited by 13
- 2025The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmascited by 12
- 2024Right vs. Right: Can LLMs Make Tough Choices?cited by 6
Built on by
Not cited yet.