mlsanityData to 7 Oct 2026

Dynamic Adaptive Attention and Supervised Contrastive Learning: A Novel Hybrid Framework for Text Sentiment Classification

arXiv 2604.10459 ↗First posted 12 Apr 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The exponential growth of user-generated movie reviews on digital platforms has made accurate text sentiment classification a cornerstone task in natural language processing. Traditional models, including standard BERT and recurrent architectures, frequently struggle to capture long-distance semantic dependencies and resolve ambiguous emotional expressions in lengthy review texts. This paper proposes a novel hybrid framework that seamlessly integrates dynamic adaptive multi-head attention with supervised contrastive learning into a BERT-based Transformer encoder. The dynamic adaptive attention module employs a global context pooling vector to dynamically regulate the contribution of each attention head, thereby focusing on critical sentiment-bearing tokens while suppressing noise. Simultaneously, the supervised contrastive learning branch enforces tighter intra-class compactness and larger inter-class separation in the embedding space. Extensive experiments on the IMDB dataset demonstrate that the proposed model achieves competitive performance with an accuracy of 94.67%, outperforming strong baselines by 1.5--2.5 percentage points. The framework is lightweight, efficient, and readily extensible to other text classification tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 14 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

8 of 14 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2020Supervised Contrastive Learningcited by 2,803
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  5. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  6. 2022Conditional Supervised Contrastive Learning for Fair Text Classificationcited by 11
  7. 2023Sentiment analysis with adaptive multi-head attention in Transformercited by 5
  8. 2022Dictionary-Assisted Supervised Contrastive Learningcited by 1

Built on by

Not cited yet.