mlsanityData to 7 Oct 2026

Language-Specific Representation of Emotion-Concept Knowledge Causally Supports Emotion Inference

arXiv 2302.09582 ↗First posted 19 Feb 2023cs.AI cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Humans no doubt use language to communicate about their emotional experiences, but does language in turn help humans understand emotions, or is language just a vehicle of communication? This study used a form of artificial intelligence (AI) known as large language models (LLMs) to assess whether language-based representations of emotion causally contribute to the AI's ability to generate inferences about the emotional meaning of novel situations. Fourteen attributes of human emotion concept representation were found to be represented by the LLM's distinct artificial neuron populations. By manipulating these attribute-related neurons, we in turn demonstrated the role of emotion concept knowledge in generative emotion inference. The attribute-specific performance deterioration was related to the importance of different attributes in human mental space. Our findings provide a proof-in-concept that even a LLM can learn about emotions in the absence of sensory-motor representations and highlight the contribution of language-derived emotion-concept knowledge for emotion inference.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 160 references that are in the map. First posted on arXiv 19 Feb 2023.

Builds on

18 of 160 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2019Language Models as Knowledge Bases?cited by 1,922
  6. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  7. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  8. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  9. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
  10. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
  11. 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
  12. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
6 more
  1. 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
  2. 2019Evaluating the Underlying Gender Bias in Contextualized Word Embeddingscited by 94
  3. 2021On Transferability of Prompt Tuning for Natural Language Processingcited by 74
  4. 2022Finding Skill Neurons in Pre-trained Transformer-based Language Modelscited by 65
  5. 2022The neuroconnectionist research programmecited by 47
  6. 2021Inspecting the concept knowledge graph encoded by modern language modelscited by 15

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 4.

6 papers.