Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities
Not on the map. Why?
Abstract (arXiv)
Inside a modern language model sits a single internal direction that tracks how positive or negative a sentence feels. We show how to find this valence axis (V-axis) from just 9 emotion category names plus 50 short narrative paragraphs per emotion -- about 1,500 fewer labels than the usual supervised approach -- and that the same direction appears in vision, audio, and human-brain encoders never jointly trained. The recipe: embed nine emotion-anchored story sets in a frozen encoder, take the top principal direction of the nine averaged embeddings. Projecting new inputs onto it captures 93% of supervised performance on SST-2 (Llama-3-8B-Instruct, AUC 0.772 vs. 0.828), correlates with human valence ratings on 11,811 EmoSet images at r=0.636, reaches AUC 0.906 on ESC-50 audio (p<2.2e-15), and AUC 0.720+/-0.055 on EEG from 123 subjects (p<3.65e-8). The direction is mechanistically active: ablating it collapses sentiment accuracy by 5.5-37.2 pp across three LLMs vs. at most 0.88 pp for matched random directions (z>12). A 2-parameter classifier trained on text labels transfers to images (AUC 0.961), audio (0.764), and brain recordings (0.828) without target-modality labels; a generic 16-D subspace stays at chance (0.525). The recipe is bounded to continuous attributes -- seven tests on categorical concepts return near-chance -- and steering is family-specific (Llama/Mistral yes, Qwen/Gemma no).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
11 of 24 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2024The Platonic Representation Hypothesiscited by 382
- 2025AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoderscited by 218
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
- 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
- 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2026Revisiting the Platonic Representation Hypothesis: An Aristotelian Viewcited by 44
Built on by
Not cited yet.