Tracing Moral Foundations in Large Language Models
On the map: Mechanistic interpretability → Probing deception, bias and beliefs
Abstract (arXiv)
Large language models often produce human-like moral judgments, but it is unclear whether this reflects an internal conceptual structure or superficial ``moral mimicry.'' Using Moral Foundations Theory (MFT) as an analytic framework, we study how moral foundations are encoded, organized, and expressed across 14 base and instruction-tuned LLMs spanning four model families (Llama, Qwen2.5, Qwen3-MoE, Mistral) and scales from 7B to 70B. We employ a multi-level approach combining (i) layer-wise analysis of MFT concept representations and their alignment with human moral perceptions, (ii) pretrained sparse autoencoders (SAEs) over the residual stream to identify sparse features that support moral concepts, and (iii) causal steering interventions using dense MFT vectors and sparse SAE features. We find that models represent and distinguish moral foundations in a manner that aligns with human judgments, and that this moral geometry naturally emerges from pretraining and is selectively rewired by post-training. At a finer scale, SAE features show clear semantic links to specific foundations, suggesting partially disentangled mechanisms within shared representations. Finally, steering along either dense vectors or sparse features produces predictable shifts in foundation-relevant behavior, demonstrating a causal connection between internal representations and moral outputs. Together, our results provide mechanistic evidence that moral concepts in LLMs are distributed, layered, and partly disentangled, suggesting that pluralistic moral structure can emerge as a latent pattern from the statistical regularities of language alone.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Probing deception, bias and beliefs, one of 13 directions in Mechanistic interpretability. Builds on 38 of its 94 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
38 of 94 references.
References · 38
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2019Invariant Risk Minimizationcited by 1,854
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
26 more
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2022Toy Models of Superpositioncited by 971
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2024Massive Activations in Large Language Modelscited by 294
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
- 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 160
- 2020Probing Pretrained Language Models for Lexical Semanticscited by 156
- 2024Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoderscited by 143
- 2025Learning Multi-Level Features with Matryoshka Sparse Autoencoderscited by 143
- 2024BatchTopK Sparse Autoencoderscited by 130
- 2024Automatically Interpreting Millions of Features in Large Language Modelscited by 113
- 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 111
- 2023Moral Foundations of Large Language Modelscited by 85
- 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 74
- 2024Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semanticscited by 44
- 2022Analyzing Encoded Concepts in Transformer Language Modelscited by 38
- 2024Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundationscited by 19
- 2024Whose Morality Do They Speak? Unraveling Cultural Bias in Multilingual Language Modelscited by 17
- 2023Measuring Moral Dimensions in Social Media with Mformercited by 13
- 2025MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanationcited by 8
- 2025Psychological Steering in LLMs: An Evaluation of Effectiveness and Trustworthinesscited by 8
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Modelscited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Modelscited by 3
- 2026Psychological Steering of Large Language Modelscited by 1
- 2026Constitutional Value Potentials: reading and steering internal priority margins in language modelscited by 1
- 2026Frame-Conditioned Moral Computation in LLaMA 3.1-8B-Instruct: A Mechanistic Interpretability Audit of Ethical Reasoningcited by 0
- 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steeringcited by 0
- 2026Echoes of Deeds: Moral History Can Shape and Steer LLM Behavioral Choicescited by 0
- 2026Echoes of Deeds: Moral History Can Shape and Steer LLM Behavioral Choices28 Sep 2026
- 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steering24 Sep 2026
- 2026Frame-Conditioned Moral Computation in LLaMA 3.1-8B-Instruct: A Mechanistic Interpretability Audit of Ethical Reasoning13 Jun 2026
- 2026Constitutional Value Potentials: reading and steering internal priority margins in language models13 Jun 2026
- 2026Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Models22 Apr 2026
- 2026Psychological Steering of Large Language Models15 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026How Language Models Organize and Structure Moral Knowledge
- 2026Mechanistic Origin of Moral Indifference in Language Models
- 2026Representational alignment yields generalizable safety in language models
- 2026Unsupervised Elicitation of Moral Values from Language Models
- 2025Differences in the Moral Foundations of Large Language Models
- 2026The Fragility Of Moral Judgment In Large Language Models
- 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability
- 2026Position: Evaluations of AI Moral Reasoning Still Miss Half of the Picture