mlsanityData to 14 Oct 2026

Tracing Moral Foundations in Large Language Models

arXiv 2601.05437 ↗First posted 9 Jan 2026cs.CL cs.AIcited by 6

On the map: Mechanistic interpretability → Probing deception, bias and beliefs

Abstract (arXiv)

Large language models often produce human-like moral judgments, but it is unclear whether this reflects an internal conceptual structure or superficial ``moral mimicry.'' Using Moral Foundations Theory (MFT) as an analytic framework, we study how moral foundations are encoded, organized, and expressed across 14 base and instruction-tuned LLMs spanning four model families (Llama, Qwen2.5, Qwen3-MoE, Mistral) and scales from 7B to 70B. We employ a multi-level approach combining (i) layer-wise analysis of MFT concept representations and their alignment with human moral perceptions, (ii) pretrained sparse autoencoders (SAEs) over the residual stream to identify sparse features that support moral concepts, and (iii) causal steering interventions using dense MFT vectors and sparse SAE features. We find that models represent and distinguish moral foundations in a manner that aligns with human judgments, and that this moral geometry naturally emerges from pretraining and is selectively rewired by post-training. At a finer scale, SAE features show clear semantic links to specific foundations, suggesting partially disentangled mechanisms within shared representations. Finally, steering along either dense vectors or sparse features produces predictable shifts in foundation-relevant behavior, demonstrating a causal connection between internal representations and moral outputs. Together, our results provide mechanistic evidence that moral concepts in LLMs are distributed, layered, and partly disentangled, suggesting that pluralistic moral structure can emerge as a latent pattern from the statistical regularities of language alone.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Probing deception, bias and beliefs, one of 13 directions in Mechanistic interpretability. Builds on 38 of its 94 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

38 of 94 references.

References · 38

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  6. 2019Invariant Risk Minimizationcited by 1,854
  7. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  8. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  9. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  10. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  11. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  12. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
26 more
  1. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  2. 2022Toy Models of Superpositioncited by 971
  3. 2023Steering Language Models With Activation Engineeringcited by 922
  4. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  5. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  6. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  7. 2024Massive Activations in Large Language Modelscited by 294
  8. 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
  9. 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
  10. 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 160
  11. 2020Probing Pretrained Language Models for Lexical Semanticscited by 156
  12. 2024Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoderscited by 143
  13. 2025Learning Multi-Level Features with Matryoshka Sparse Autoencoderscited by 143
  14. 2024BatchTopK Sparse Autoencoderscited by 130
  15. 2024Automatically Interpreting Millions of Features in Large Language Modelscited by 113
  16. 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 111
  17. 2023Moral Foundations of Large Language Modelscited by 85
  18. 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 74
  19. 2024Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semanticscited by 44
  20. 2022Analyzing Encoded Concepts in Transformer Language Modelscited by 38
  21. 2024Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundationscited by 19
  22. 2024Whose Morality Do They Speak? Unraveling Cultural Bias in Multilingual Language Modelscited by 17
  23. 2023Measuring Moral Dimensions in Social Media with Mformercited by 13
  24. 2025MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanationcited by 8
  25. 2025Psychological Steering in LLMs: An Evaluation of Effectiveness and Trustworthinesscited by 8
  26. 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Language Models Organize and Structure Moral Knowledge
  2. 2026Mechanistic Origin of Moral Indifference in Language Models
  3. 2026Representational alignment yields generalizable safety in language models
  4. 2026Unsupervised Elicitation of Moral Values from Language Models
  5. 2025Differences in the Moral Foundations of Large Language Models
  6. 2026The Fragility Of Moral Judgment In Large Language Models
  7. 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability
  8. 2026Position: Evaluations of AI Moral Reasoning Still Miss Half of the Picture