AIPsy-Affect: A Keyword-Free Clinical Stimulus Battery for Mechanistic Interpretability of Emotion in Language Models
Not on the map. Why?
Abstract (arXiv)
Mechanistic interpretability research on emotion in large language models -- linear probing, activation patching, sparse autoencoder (SAE) feature analysis, causal ablation, steering vector extraction -- depends on stimuli that contain the words for the emotions they test. When a probe fires on "I am furious", it is unclear whether the model has detected anger or detected the word "furious". The two readings have very different consequences for every downstream claim about emotion circuits, features, and interventions. We release AIPsy-Affect, a 480-item clinical stimulus battery that removes the confound at the stimulus level: 192 keyword-free vignettes evoking each of Plutchik's eight primary emotions through narrative situation alone, 192 matched neutral controls that share characters, setting, length, and surface structure with the affect surgically removed, plus moderate-intensity and discriminant-validity splits. The matched-pair structure supports linear probing, activation patching, SAE feature analysis, causal ablation, and steering vector extraction under a strong methodological guarantee: any internal representation that distinguishes a clinical item from its matched neutral cannot be doing so on the basis of emotion-keyword presence. A three-method NLP defense battery -- bag-of-words sentiment, an emotion-category lexicon, and a contextual transformer classifier -- confirms the property: bag-of-words methods see only situational vocabulary, and a contextual classifier detects affect (p < 10^-15) but cannot identify the category (5.2% top-1 vs. 82.5% on a keyword-rich control). AIPsy-Affect extends our earlier 96-item battery (arXiv:2603.22295) by a factor of four and is released openly under MIT license.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
10 of 17 references.
References · 10
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2013Crowdsourcing a Word-Emotion Association Lexiconcited by 193
- 2026Emotion Concepts and their Function in a Large Language Modelcited by 48
- 2022Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Predictioncited by 45
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 24
- 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Modelscited by 14
- 2025Do LLMs "Feel"? Emotion Circuits Discovery and Controlcited by 13
- 2026Discovering and Causally Validating Emotion-Sensitive Neurons in Large Audio-Language Modelscited by 6
- 2026Whether, Not Which: Mechanistic Interpretability Reveals Dissociable Affect Reception and Emotion Categorization in LLMscited by 1
Built on by
Not cited yet.