mlsanityData to 7 Oct 2026

Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering

arXiv 2609.39701 ↗First posted 30 Sep 2026cs.AI cs.CY cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Value steering should change an LLM's normative priorities while preserving the scenario, facts, and task constraints underlying its answer. Conventional activation edits often change both. We introduce an editable semantic-value interface on frozen residual states, with a one-way semantic-to-value pathway that grounds value recognition in context. Stop-gradient blocks feedback through this pathway; swap consistency, topic de-confounding, and decorrelation encourage selective codes. At inference, editing the value code produces a residual delta while holding the semantic code fixed. On two instruction-tuned backbones, this interface improves semantic preservation and reduces benign refusals at comparable value alignment. A matched mixing-by-gating ablation separates representation learning from selective edit activation, and dimension-matched probes establish improved code selectivity. Against validation-selected prompting on LLaMA-3.1-8B, the method achieves comparable alignment (0.750 vs. 0.748), higher BERTScore (0.938 vs. 0.923), and fewer contradictions (5.1% vs. 7.6%). Human ratings and cross-taxonomy controls provide complementary evidence for low-damage value steering.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 35 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

32 of 35 references.

References · 32

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2017Squeeze-and-Excitation Networkscited by 4,763
  6. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  7. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  8. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  10. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  11. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  12. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
20 more
  1. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  3. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  4. 2022Mass-Editing Memory in a Transformercited by 976
  5. 2023Steering Language Models With Activation Engineeringcited by 824
  6. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  7. 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
  8. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  9. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  10. 2018Disentangled Representation Learning for Non-Parallel Text Style Transfercited by 127
  11. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  12. 2024Steering Language Model Refusal with Sparse Autoencoderscited by 89
  13. 2020Improving Disentangled Text Representation Learning with Information-Theoretic Guidancecited by 52
  14. 2024ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Modelscited by 19
  15. 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activationcited by 14
  16. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  17. 2024Resolving Lexical Bias in Model Editingcited by 4
  18. 2025The Anatomy of Alignment: Decomposing Preference Optimization by Steering Sparse Featurescited by 3
  19. 2026Steering Language Models Before They Speak: Logit-Level Interventionscited by 3
  20. 2026YaPO: Learnable Sparse Activation Steering Vectors for Domain Adaptationcited by 2

Built on by

Not cited yet.