Are Emotions Arranged in a Circle? Geometric Analysis of Emotion Representations via Hyperspherical Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Psychological research has long utilized circumplex models to structure emotions, placing similar emotions adjacently and opposing ones diagonally. Although frequently used to interpret deep learning representations, these models are rarely directly incorporated into the representation learning of language models, leaving their geometric validity unexplored. This paper proposes a method to induce circular emotion representations within language model embeddings via contrastive learning on a hypersphere. We show that while this circular alignment offers superior interpretability and robustness against dimensionality reduction, it underperforms compared to conventional designs in high-dimensional settings and fine-grained classification. Our findings elucidate the trade-offs involved in applying psychological circumplex models to deep learning architectures.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 53 references that are in the map. First posted on arXiv 10 Jan 2026.
Builds on
21 of 53 references.
References · 21
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2022Towards Understanding Grokking: An Effective Theory of Representation Learningcited by 229
- 2024Not All Language Model Features Are One-Dimensionally Linearcited by 201
- 2021Dissecting Supervised Contrastive Learningcited by 64
- 2019Spherical Text Embeddingcited by 49
9 more
- 2025Llama-Embed-Nemotron-8B: A Universal Text Embedding Model for Multilingual and Cross-Lingual Taskscited by 46
- 2021A Circular-Structured Representation for Visual Emotion Distribution Learningcited by 17
- 2020AMC-Loss: Angular Margin Contrastive Loss for Improved Explainability in Image Classificationcited by 14
- 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Modelscited by 14
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Surveycited by 12
- 2025Persona-Based Synthetic Data Generation Using Multi-Stage Conditioning with Large Language Models for Emotion Recognitioncited by 5
- 2021Enhancing Cognitive Models of Emotions with Representation Learningcited by 3
- 2023SINCERE: Supervised Information Noise-Contrastive Estimation REvisitedcited by 3
- 2025Mapping Semantic & Syntactic Relationships with Geometric Rotationcited by 1
Built on by
Not cited yet.