Dynamic Adaptive Attention and Supervised Contrastive Learning: A Novel Hybrid Framework for Text Sentiment Classification
Not on the map. Why?
Abstract (arXiv)
The exponential growth of user-generated movie reviews on digital platforms has made accurate text sentiment classification a cornerstone task in natural language processing. Traditional models, including standard BERT and recurrent architectures, frequently struggle to capture long-distance semantic dependencies and resolve ambiguous emotional expressions in lengthy review texts. This paper proposes a novel hybrid framework that seamlessly integrates dynamic adaptive multi-head attention with supervised contrastive learning into a BERT-based Transformer encoder. The dynamic adaptive attention module employs a global context pooling vector to dynamically regulate the contribution of each attention head, thereby focusing on critical sentiment-bearing tokens while suppressing noise. Simultaneously, the supervised contrastive learning branch enforces tighter intra-class compactness and larger inter-class separation in the embedding space. Extensive experiments on the IMDB dataset demonstrate that the proposed model achieves competitive performance with an accuracy of 94.67%, outperforming strong baselines by 1.5--2.5 percentage points. The framework is lightweight, efficient, and readily extensible to other text classification tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 14 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
8 of 14 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Supervised Contrastive Learningcited by 2,803
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2022Conditional Supervised Contrastive Learning for Fair Text Classificationcited by 11
- 2023Sentiment analysis with adaptive multi-head attention in Transformercited by 5
- 2022Dictionary-Assisted Supervised Contrastive Learningcited by 1
Built on by
Not cited yet.