Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotion
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are increasingly expected to navigate the nuances of human emotion. While research confirms that LLMs can simulate emotional intelligence, their internal emotional mechanisms remain largely unexplored. This paper investigates the latent emotional representations within modern LLMs by asking: how, where, and for how long is emotion encoded in their neural architecture? To address this, we introduce a novel, large-scale Reddit corpus of approximately 400,000 utterances, balanced across seven basic emotions through a multi-stage process of classification, rewriting, and synthetic generation. Using this dataset, we employ lightweight "probes" to read out information from the hidden layers of various Qwen3 and LLaMA models without altering their parameters. Our findings reveal that LLMs develop a surprisingly well-defined internal geometry of emotion, which sharpens with model scale and significantly outperforms zero-shot prompting. We demonstrate that this emotional signal is not a final-layer phenomenon but emerges early and peaks mid-network. Furthermore, the internal states are both malleable (they can be influenced by simple system prompts) and persistent, as the initial emotional tone remains detectable for hundreds of subsequent tokens. We contribute our dataset, an open-source probing toolkit, and a detailed map of the emotional landscape within LLMs, offering crucial insights for developing more transparent and aligned AI systems. The code and dataset are open-sourced.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
23 of 37 references.
References · 23
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 382
11 more
- 2017Learning to Generate Reviews and Discovering Sentimentcited by 147
- 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
- 2022EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysiscited by 75
- 2024EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysiscited by 62
- 2024Emergence of a High-Dimensional Abstraction Phase in Language Transformerscited by 56
- 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
- 2023Instruction-tuning Aligns LLMs to the Human Braincited by 39
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 29
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 24
- 2024NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional Stimulicited by 18
- 2024GPT-4 Emulates Average-Human Emotional Cognition from a Third-Person Perspectivecited by 16
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Gemma Needs Help: Investigating and Mitigating Emotional Instability in LLMscited by 4
- 2026Where meaning lives: Layer-wise accessibility of psycholinguistic features in encoder and decoder language modelscited by 2
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processingcited by 1
- 2026Quantitative Introspection in Language Models: Tracking Emotive States Across Conversationcited by 1
- 2026Whether, Not Which: Mechanistic Interpretability Reveals Dissociable Affect Reception and Emotion Categorization in LLMscited by 1
- 2026How Emotion Shapes the Behavior of LLMs and Agents: A Mechanistic Studycited by 1
- 2026Negative Before Positive: Asymmetric Valence Processing in Large Language Modelscited by 0
- 2026Relational Intervention During Functional Collapse in Large Language Models: A Lexical-Statistical Ablation and a Structure x Register Factorialcited by 0
- 2026A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representationscited by 0
- 2026TabPFN beyond Tabular Data: Calibration and Accuracy on Multimodal Embeddingscited by 0
- 2026TabPFN beyond Tabular Data: Calibration and Accuracy on Multimodal Embeddings13 Jul 2026
- 2026A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations4 Jun 2026
- 2026Relational Intervention During Functional Collapse in Large Language Models: A Lexical-Statistical Ablation and a Structure x Register Factorial31 May 2026
- 2026Negative Before Positive: Asymmetric Valence Processing in Large Language Models7 May 2026
- 2026Quantitative Introspection in Language Models: Tracking Emotive States Across Conversation19 Mar 2026
- 2026Whether, Not Which: Mechanistic Interpretability Reveals Dissociable Affect Reception and Emotion Categorization in LLMs15 Mar 2026
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing10 Mar 2026
- 2026How Emotion Shapes the Behavior of LLMs and Agents: A Mechanistic Study9 Mar 2026
- 2026Gemma Needs Help: Investigating and Mitigating Emotional Instability in LLMs17 Feb 2026
- 2026Where meaning lives: Layer-wise accessibility of psycholinguistic features in encoder and decoder language models7 Jan 2026