Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Emotion is expressed in text along a wide spectrum, from surface lexical cues to inferences entangled with content. Most layer-wise analyses of emotion in LLMs use a single corpus, leaving open whether the depth at which emotion becomes accessible is a property of the model or also of the text source. We investigate this across three datasets spanning different degrees of explicitness and contextualization in emotion expression (Twitter posts, Reddit comments, and autobiographical narratives) and eight 1B--9B open-weight LLMs from the Llama, Qwen, and Granite families. We combine layer-wise probing with offline feature scaling and online forward interventions, transfer analyses, and an early-exit classifier. We find that (i) the best probing layer shifts systematically across corpora, from input-adjacent layers to over half model depth, and this ordering persists after matching label-by-length-bin distributions; (ii) across the evaluated settings, forward-pass interventions on probe-selected bands reduce test accuracy by 5--6 points more than same-width random bands (q < 0.01); (iii) selected bands transfer across datasets and emotion categories, suggesting partially shared affective information rather than strictly per-emotion substrates; and (iv) probe-selected early-exit representations outperform full-depth exits by 6.9 percentage points on average.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
19 of 36 references.
References · 19
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2019Designing and Interpreting Probes with Control Taskscited by 640
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
- 2019Reducing Transformer Depth on Demand with Structured Dropoutcited by 439
- 2020DeeBERT: Dynamic Early Exiting for Accelerating BERT Inferencecited by 332
- 2019Do NLP Models Know Numbers? Probing Numeracy in Embeddingscited by 159
- 2023The Hydra Effect: Emergent Self-repair in Language Model Computationscited by 156
7 more
- 2020The Right Tool for the Job: Matching Model and Instance Complexitiescited by 126
- 2020On the Effect of Dropping Layers of Pre-trained Transformer Modelscited by 118
- 2024Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversationcited by 55
- 2022Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Predictioncited by 46
- 2017Emotion Intensities in Tweetscited by 32
- 2020Appraisal Theories for Emotion Classification in Textcited by 28
- 2025LLaMAs Have Feelings Too: Unveiling Sentiment and Emotion Representations in LLaMA Models Through Probingcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Models
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing
- 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Models
- 2026Why Are Some Emotions Harder for LLMs? Uncovering the Causal Mechanisms of Emotion Inference via Sparse Autoencoders
- 2026Negative Before Positive: Asymmetric Valence Processing in Large Language Models
- 2026Emotion Concepts and their Function in a Large Language Model
- 2026Read-Best Is Not Steer-Best: A Probing--Steering Layer Dissociation in Omni-Modal Large Language Models
- 2025Emo Pillars: Knowledge Distillation to Support Fine-Grained Context-Aware and Context-Less Emotion Classification