Data-Driven Decoding of Russell's Circumplex Model of Affect
Not on the map. Why?
Abstract (arXiv)
Affective computing increasingly relies on deep learning to represent emotions, yet latent spaces often remain opaque, high-dimensional black boxes. This paper investigates whether Transformers' embeddings recover the geometric regularities of Russell's circumplex model. We unify two complementary experiments testing the hypothesis that, after training models on text and speech, their resulting latent spaces encode a topology consistent with valence-arousal and reproduce human-like neighborhood relations. Specifically, we evaluate deep representations extracted from Transformer-based text (RoBERTa) and speech (wav2vec 2.0) encoders, along with a multimodal Transformer fusion architecture, across naturalistic datasets like MSP-Podcast and controlled LLM-generated stimuli. Our analysis reveals that multimodal fusion of text and audio yields perfect topological alignment with Russell's primary emotion ordering. Furthermore, in a zero-shot setting using generic text embeddings, projected fine-grained emotion terms fall close to their established human-mapped coordinates. Our contribution is a novel, data-driven framework for validating emotion models, demonstrating that Russell's circumplex structure is intrinsically encoded in the embeddings of these modalities rather than being solely an artifact of human labeling, thereby bridging the gap between psychological theory and representation learning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 28 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
6 of 28 references.
References · 6
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2022Dawn of the transformer era in speech emotion recognition: closing the valence gapcited by 157
- 2021Leveraging Recent Advances in Deep Learning for Audio-Visual Emotion Recognitioncited by 30
- 2019The Ambiguous World of Emotion Representationcited by 16
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Audio emotion recognition for atypical hearingcited by 0
- 2026Audio emotion recognition for atypical hearing25 Sep 2026