mlsanityData to 7 Oct 2026

Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotion

arXiv 2510.04064 ↗First posted 5 Oct 2025cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly expected to navigate the nuances of human emotion. While research confirms that LLMs can simulate emotional intelligence, their internal emotional mechanisms remain largely unexplored. This paper investigates the latent emotional representations within modern LLMs by asking: how, where, and for how long is emotion encoded in their neural architecture? To address this, we introduce a novel, large-scale Reddit corpus of approximately 400,000 utterances, balanced across seven basic emotions through a multi-stage process of classification, rewriting, and synthetic generation. Using this dataset, we employ lightweight "probes" to read out information from the hidden layers of various Qwen3 and LLaMA models without altering their parameters. Our findings reveal that LLMs develop a surprisingly well-defined internal geometry of emotion, which sharpens with model scale and significantly outperforms zero-shot prompting. We demonstrate that this emotional signal is not a final-layer phenomenon but emerges early and peaks mid-network. Furthermore, the internal states are both malleable (they can be influenced by simple system prompts) and persistent, as the initial emotional tone remains detectable for hundreds of subsequent tokens. We contribute our dataset, an open-source probing toolkit, and a detailed map of the emotional landscape within LLMs, offering crucial insights for developing more transparent and aligned AI systems. The code and dataset are open-sourced.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

23 of 37 references.

References · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  5. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  6. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  7. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  8. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
  9. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  10. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  11. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
  12. 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 382
11 more
  1. 2017Learning to Generate Reviews and Discovering Sentimentcited by 147
  2. 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
  3. 2022EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysiscited by 75
  4. 2024EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysiscited by 62
  5. 2024Emergence of a High-Dimensional Abstraction Phase in Language Transformerscited by 56
  6. 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
  7. 2023Instruction-tuning Aligns LLMs to the Human Braincited by 39
  8. 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 29
  9. 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 24
  10. 2024NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional Stimulicited by 18
  11. 2024GPT-4 Emulates Average-Human Emotional Cognition from a Third-Person Perspectivecited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.