Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison
Not on the map. Why?
Abstract (arXiv)
Small language models (SLMs) in the 100M-10B parameter range increasingly power production systems, yet whether they possess the internal emotion representations recently discovered in frontier models remains unknown. We present the first comparative analysis of emotion vector extraction methods for SLMs, evaluating 9 models across 5 architectural families (GPT-2, Gemma, Qwen, Llama, Mistral) using 20 emotions and two extraction methods (generation-based and comprehension-based). Generation-based extraction produces statistically superior emotion separation (Mann-Whitney p = 0.007; Cohen's d = -107.5), with the advantage modulated by instruction tuning and architecture. Emotion representations localize at middle transformer layers (~50% depth), following a U-shaped curve that is architecture-invariant from 124M to 3B parameters. We validate these findings against representational anisotropy baselines across 4 models and confirm causal behavioral effects through steering experiments, independently verified by an external emotion classifier (92% success rate, 37/40 scenarios). Steering reveals three regimes -- surgical (coherent text transformation), repetitive collapse, and explosive (text degradation) -- quantified by perplexity ratios and separated by model architecture rather than scale. We document cross-lingual emotion entanglement in Qwen, where steering activates semantically aligned Chinese tokens that RLHF does not suppress, raising safety concerns for multilingual deployment. This work provides methodological guidelines for emotion research on open-weight models and contributes to the Model Medicine series by bridging external behavioral profiling with internal representational analysis.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 6 of its 17 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
6 of 17 references.
References · 6
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2023Personality Traits in Large Language Modelscited by 166
- 2026MTI: A Behavior-Based Temperament Profiling System for AI Agentscited by 3
- 2026Model Medicine: A Clinical Framework for Understanding, Diagnosing, and Treating AI Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Shared Emotion Geometry Across Small Language Models: A Cross-Architecture Study of Representation, Behavior, and Methodological Confoundscited by 0
- 2026Relational Intervention During Functional Collapse in Large Language Models: A Lexical-Statistical Ablation and a Structure x Register Factorialcited by 0
- 2026Relational Intervention During Functional Collapse in Large Language Models: A Lexical-Statistical Ablation and a Structure x Register Factorial31 May 2026
- 2026Shared Emotion Geometry Across Small Language Models: A Cross-Architecture Study of Representation, Behavior, and Methodological Confounds13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models
- 2026Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
- 2024Rethinking Emotion Annotations in the Era of Large Language Models
- 2026Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?
- 2025MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective
- 2025Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models
- 2026E3mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment