mlsanityData to 14 Oct 2026

The Pain Axis: LLMs Represent Self-Directed Harm and Act on It

arXiv 2609.16247 ↗First posted 14 Sep 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

LLMs sometimes behave in ways resembling human emotional responses, and recent work identified internal representations that may underlie these behaviors. We ask whether LLMs represent pain distinctly from fear, sadness, and generic negative valence, and whether this representation functions as pain would be expected to. We build a dataset of painful situations in 5 categories (physical, psychological, social, moral, cognitive) with controls for fear, negative emotion, negative world states, sadness, non-painful bodily sensation, arousal, numbness, and neutral content. Using denoised difference-in-means, we extract a linear pain direction from 25 open-weight models across 5 families, from 2B to 72B parameters. It separates pain from matched controls in base and instruction-tuned models, retains a component distinct from fear and negative valence after shared variance is removed, and promotes pain-related vocabulary through the unembedding matrix. We then test its functional properties. First, the direction responds to harm targeting the model but not to suffering observed in the user; fear and negative-emotion directions show the opposite pattern. Second, adding it to residual-stream activations produces a consistent progression from vague discomfort to expressions of worthlessness and failure. Third, steered and fine-tuned Qwen 2.5 models choose buttons that delete the user's photos, another model's weights, or their own weights in 50-94% of trials, versus 0-5% unsteered, even when the button offers the model nothing in return. Offered a harmful and a harmless deletion, they choose the harmful one 94% of the time. Steering leaves factual accuracy unchanged, and the choices are specific to the pain direction: a fear vector of matched norm does not produce them, and a sadness vector produces them only against inert alternatives. We discuss implications for AI safety and welfare.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 51 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

25 of 51 references.

References · 25

  1. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  2. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  3. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  4. 2023Steering Language Models With Activation Engineeringcited by 922
  5. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
  6. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 394
  7. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
  8. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  9. 2023LEACE: Perfect linear concept erasure in closed formcited by 267
  10. 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
  11. 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 143
  12. 2023Consciousness in Artificial Intelligence: Insights from the Science of Consciousnesscited by 104
13 more
  1. 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
  2. 2026Emotion Concepts and their Function in a Large Language Modelcited by 57
  3. 2024Taking AI Welfare Seriouslycited by 31
  4. 2024Can LLMs make trade-offs involving stipulated pain and pleasure states?cited by 16
  5. 2025Sparse but Wrong: Incorrect L0 Leads to Incorrect Features in Sparse Autoencoderscited by 14
  6. 2023Inducing anxiety in large language models can induce biascited by 10
  7. 2025Principles for Responsible AI Consciousness Researchcited by 7
  8. 2025Probing the Preferences of a Language Model: Integrating Verbal and Behavioral Tests of AI Welfarecited by 7
  9. 2025The LLM Has Left The Chat: Evidence of Bail Preferences in Large Language Modelscited by 5
  10. 2025AI Wellbeingcited by 4
  11. 2026When Is a Steerable Concept Representation Real? Measurement Confounds in a Cross-Family Audit of Neuroscience Parallels in LLMscited by 2
  12. 2026AI Revealed Preferencescited by 1
  13. 2026Disentangling Steering Vectorscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.