mlsanityData to 7 Oct 2026

Negative Before Positive: Asymmetric Valence Processing in Large Language Models

arXiv 2605.05653 ↗First posted 7 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Mechanistic interpretability has revealed how concepts are encoded in large language models (LLMs), but emotional content remains poorly understood at the mechanistic level. We study whether LLMs process emotional valence through dedicated internal structure or through surface token matching. Using activation patching and steering on open-source LLMs, we find that negative and positive valence are processed at different network depths. Negative outcomes localize to early layers while positive outcomes peak at mid-to-late layers. Holding topic fixed while flipping valence produces sign-opposite responses, ruling out topic detection. Steering with the good-news direction at the identified layers shifts neutral prompts toward positive valence, showing these layers encode valence as a manipulable direction. Emotional valence in LLMs is localized, causal and steerable, making it a concrete target for interpretability-based oversight.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

20 of 30 references.

References · 20

  1. 2024Qwen2.5 Technical Reportcited by 4,713
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  4. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  5. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  6. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  7. 2022In-context Learning and Induction Headscited by 930
  8. 2022Toy Models of Superpositioncited by 928
  9. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  10. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  11. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  12. 2020Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Biascited by 183
8 more
  1. 2023Linear Representations of Sentiment in Large Language Modelscited by 157
  2. 2023Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchillacited by 145
  3. 2020Multi-Head Attention: Collaborate Instead of Concatenatecited by 56
  4. 2026Emotion Concepts and their Function in a Large Language Modelcited by 48
  5. 2024Dialect prejudice predicts AI decisions about people's character, employability, and criminalitycited by 35
  6. 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 24
  7. 2025Do LLMs "Feel"? Emotion Circuits Discovery and Controlcited by 13
  8. 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotioncited by 10

Built on by

Not cited yet.