Continuous Adversarial Text Representation Learning for Affective Recognition
Not on the map. Why?
Abstract (arXiv)
While pre-trained language models excel at semantic understanding, they often struggle to capture nuanced affective information critical for affective recognition tasks. To address these limitations, we propose a novel framework for enhancing emotion-aware embeddings in transformer-based models. Our approach introduces a continuous valence-arousal labeling system to guide contrastive learning, which captures subtle and multi-dimensional emotional nuances more effectively. Furthermore, we employ a dynamic token perturbation mechanism, using gradient-based saliency to focus on sentiment-relevant tokens, improving model sensitivity to emotional cues. The experimental results demonstrate that the proposed framework outperforms existing methods, achieving up to 15.5% improvement in the emotion classification benchmark, highlighting the importance of employing continuous labels. This improvement demonstrates that the proposed framework is effective in affective representation learning and enables precise and contextually relevant emotional understanding.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 28 Feb 2025.
Builds on
14 of 28 references.
References · 14
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2018SentEval: An Evaluation Toolkit for Universal Sentence Representationscited by 294
- 2019BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysiscited by 176
- 2020On the Sentence Embeddings from Pre-trained Language Modelscited by 83
- 2022EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysiscited by 75
- 2021Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Trainingcited by 37
- 2020SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semanticscited by 30
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversationcited by 9
Built on by
Not cited yet.