mlsanityData to 7 Oct 2026

Shared Emotion Geometry Across Small Language Models: A Cross-Architecture Study of Representation, Behavior, and Methodological Confounds

arXiv 2604.11050 ↗First posted 13 Apr 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We extract 21-emotion vector sets from twelve small language models (six architectures x base/instruct, 1B-8B parameters) under a unified comprehension-mode pipeline at fp16 precision, and compare the resulting geometries via representational similarity analysis on raw cosine RDMs. The five mature architectures (Qwen 2.5 1.5B, SmolLM2 1.7B, Llama 3.2 3B, Mistral 7B v0.3, Llama 3.1 8B) share nearly identical 21-emotion geometry, with pairwise RDM Spearman correlations of 0.74-0.92. This universality persists across diametrically opposed behavioral profiles: Qwen 2.5 and Llama 3.2 occupy opposite poles of MTI Compliance facets yet produce nearly identical emotion RDMs (rho = 0.81), so behavioral facet differences arise above the shared emotion representation. Gemma-3 1B base, the one immature case in our dataset, exhibits extreme residual-stream anisotropy (0.997) and is restructured by RLHF across all geometric descriptors, whereas the five already-mature families show within-family base x instruct RDM correlations of rho >= 0.92 (Mistral 7B v0.3 at rho = 0.985), suggesting RLHF restructures only representations that are not yet organized. Methodologically, we show that what prior work has read as a single comprehension-vs-generation method effect in fact decomposes into four distinct layers -- a coarse method-dependent dissociation, robust sub-parameter sensitivity within generation, a true precision (fp16 vs INT8) effect, and a conflated cross-experiment bias that distorts in opposite directions for different models -- so that a single rho between two prior emotion-vector studies is not a safe basis for interpretation without the layered decomposition.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 13 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

11 of 13 references.

References · 11

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2024Qwen2.5 Technical Reportcited by 4,713
  3. 2023LIMA: Less Is More for Alignmentcited by 1,080
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  5. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  6. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
  7. 2023The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learningcited by 251
  8. 2017All-but-the-Top: Simple and Effective Postprocessing for Word Representationscited by 205
  9. 2026Emotion Concepts and their Function in a Large Language Modelcited by 48
  10. 2026MTI: A Behavior-Based Temperament Profiling System for AI Agentscited by 3
  11. 2026Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparisoncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?
  2. 2025Bridging the behavior-neural gap: A multimodal AI reveals the brain's geometry of emotion more accurately than human self-reports
  3. 2025Correspondence of high-dimensional emotion structures elicited by video clips between humans and Multimodal LLMs
  4. 2026Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
  5. 2024Probing the contents of semantic representations from text, behavior, and brain data using the psychNorms metabase
  6. 2026E3mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment
  7. 2025Emergence of Hierarchical Emotion Organization in Large Language Models
  8. 2026Decoding Affective Nuances: Enhancing MLLMs via Hierarchical Emotion Reasoning and Contrastive Discriminative Pruning