mlsanityData to 7 Oct 2026

Controllable Value Alignment in Large Language Models through Neuron-Level Editing

arXiv 2602.07356 ↗First posted 7 Feb 2026cs.LGcited by 3

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Aligning large language models (LLMs) with human values has become increasingly important as their influence on human behavior and decision-making expands. However, existing steering-based alignment methods suffer from limited controllability: steering a target value often unintentionally activates other, non-target values. To characterize this limitation, we introduce value leakage, a diagnostic notion that captures the unintended activation of non-target values during value steering, along with a normalized leakage metric grounded in Schwartz's value theory. In light of this analysis, we propose NeVA, a neuron-level editing framework for controllable value alignment in LLMs. NeVA identifies sparse, value-relevant neurons and performs inference-time activation editing, enabling fine-grained control without parameter updates or retraining. Experiments show that NeVA achieves stronger target value alignment while incurring smaller performance degradation on general capability. Moreover, NeVA significantly reduces the average leakage, with residual effects largely confined to semantically related value classes. Overall, NeVA offers a more controllable and interpretable mechanism for value alignment.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 17 of its 30 references that are in the map. First posted on arXiv 7 Feb 2026.

Builds on

17 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activation15 Jul
  2. 2022Constitutional AI: Harmlessness from AI Feedback15 Dec

Other references · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  3. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  5. 2023Steering Language Models With Activation Engineeringcited by 824
  6. 2022Self-critiquing models for assisting human evaluatorscited by 372
  7. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
  8. 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 147
  9. 2023Improving Activation Steering in Language Models with Mean-Centringcited by 64
  10. 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 49
  11. 2023Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learningcited by 26
  12. 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
3 more
  1. 2025A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategycited by 20
  2. 2025Understanding How Value Neurons Shape the Generation of Specified Values in LLMscited by 13
  3. 2024How Does DPO Reduce Toxicity? A Mechanistic Neuron-Level Analysiscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Toward Stable Value Alignment: Introducing Independent Modules for Consistent Value Guidance
  2. 2026VISA: Value Injection via Shielded Adaptation for Personalized LLM Alignment
  3. 2024Are the Values of LLMs Structurally Aligned with Humans? A Causal Perspective
  4. 2024Aligning Large Language Models with Representation Editing: A Control Perspective
  5. 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges
  6. 2026VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Models
  7. 2025Multi-Value Alignment for LLMs via Value Decorrelation and Extrapolation
  8. 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models