The Straight and Narrow: Do LLMs Possess an Internal Moral Path?
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
also in 1 more
Abstract (arXiv)
Enhancing the moral alignment of Large Language Models (LLMs) is a critical challenge in AI safety. Current alignment techniques often act as superficial guardrails, leaving the intrinsic moral representations of LLMs largely untouched. In this paper, we bridge this gap by leveraging Moral Foundations Theory (MFT) to map and manipulate the fine-grained moral landscape of LLMs. Through cross-lingual linear probing, we validate the shared nature of moral representations in middle layers and uncover a shared yet different moral subspace between English and Chinese. Building upon this, we extract steerable Moral Vectors and successfully validate their efficacy at both internal and behavioral levels. Leveraging the high generalizability of morality, we propose Adaptive Moral Fusion (AMF), a dynamic inference-time intervention that synergizes probe detection with vector injection to tackle the safety-helpfulness trade-off. Empirical results confirm that our approach acts as a targeted intrinsic defense, effectively reducing incorrect refusals on benign queries while minimizing jailbreak success rates compared to standard baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 10 of its 20 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
10 of 20 references.
References · 10
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2023Moral Foundations of Large Language Modelscited by 84
- 2025Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflectioncited by 25
- 2025Biased Tales: Cultural and Topic Bias in Generating Children's Storiescited by 15
- 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmascited by 13
- 2025What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMscited by 6
- 2025Differences in the Moral Foundations of Large Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024MoralBench: Moral Evaluation of LLMs
- 2025Beyond Ethical Alignment: Evaluating LLMs as Artificial Moral Assistants
- 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
- 2024Language Model Alignment in Multilingual Trolley Problems
- 2026Representational alignment yields generalizable safety in language models
- 2026Unsupervised Elicitation of Moral Values from Language Models
- 2026Untangling Input Language from Reasoning Language: A Diagnostic Framework for Cross-Lingual Moral Alignment in LLMs
- 2025Diverse Human Value Alignment for Large Language Models via Ethical Reasoning