A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularity
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have emerged as powerful representation learners whose internal features increasingly align with human cognition. We study whether modern LLMs can serve as a lens for understanding neural representations in the human brain, focusing on emotional valence in EEG. We first build a one-dimensional valence direction, the V-axis, from modern LLMs using only nine emotion-evocative sentences. We validate it through zero-shot transfer to sentiment benchmarks and cross-model consistency across fourteen LLMs. We then show that this LLM-derived direction maps onto human neural activity. On a public EEG cohort of 123 subjects watching affective videos, a single linear projection on EEG features tracks the V-axis position of each stimulus. Moreover, 36 EEG emotion classifiers trained without exposure to the V-axis spontaneously rediscover the same direction in their internal representations, suggesting that the same valence structure emerges in both language models and human electrophysiology. Yet this convergence does not provide an effective training signal. We test twenty-five alignment strategies, including knowledge distillation, representational similarity, contrastive, and topographic losses; none improve decoding, and sixteen significantly reduce accuracy. We formalize this result as the saturation regularity: once task labels alone drive a brain-decoding network onto the target direction, additional supervision mainly distorts an already-saturated basin, while the load-bearing within-class residual receives little useful gradient. This regularity also indicates where improvement should come from: the residual subspace unreachable by supervision. Motivated by this insight, we ensemble across residual diversity rather than supervising the basin, improving balanced accuracy by 10.5% over the prior best on FACED, with the same effect replicated on SEED-V.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 61 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
26 of 61 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020Supervised Contrastive Learningcited by 2,803
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
14 more
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
- 2019Relational Knowledge Distillationcited by 873
- 2019Contrastive Representation Distillationcited by 734
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 627
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2019SemEval-2017 Task 4: Sentiment Analysis in Twittercited by 209
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
- 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 70
- 2026Emotion Concepts and their Function in a Large Language Modelcited by 48
- 2020Subclass Distillationcited by 23
- 2024When Does Perceptual Alignment Benefit Vision Representations?cited by 18
- 2025EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive Learningcited by 2
- 2024Linear Projections of Teacher Embeddings for Few-Class Distillationcited by 1
Built on by
Not cited yet.