Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extraction
Not on the map. Why?
Abstract (arXiv)
Aspect-level sentiment classification (ALSC) aims at identifying the sentiment polarity of a specified aspect in a sentence. ALSC is a practical setting in aspect-based sentiment analysis due to no opinion term labeling needed, but it fails to interpret why a sentiment polarity is derived for the aspect. To address this problem, recent works fine-tune pre-trained Transformer encoders for ALSC to extract an aspect-centric dependency tree that can locate the opinion words. However, the induced opinion words only provide an intuitive cue far below human-level interpretability. Besides, the pre-trained encoder tends to internalize an aspect's intrinsic sentiment, causing sentiment bias and thus affecting model performance. In this paper, we propose a span-based anti-bias aspect representation learning framework. It first eliminates the sentiment bias in the aspect embedding by adversarial learning against aspects' prior sentiment. Then, it aligns the distilled opinion candidates with the aspect by span-based dependency modeling to highlight the interpretable opinion terms. Our method achieves new state-of-the-art performance on five benchmarks, with the capability of unsupervised opinion extraction.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 6 Sep 2021.
Builds on
19 of 34 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
- 2017A Structured Self-attentive Sentence Embeddingcited by 318
- 2017End-to-end Neural Coreference Resolutioncited by 240
- 2019Reducing Sentiment Bias in Language Models via Counterfactual Evaluationcited by 148
- 2019Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysiscited by 123
- 2019Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentencecited by 121
- 2020Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERTcited by 109
- 2020Relational Graph Attention Network for Aspect-based Sentiment Analysiscited by 104
- 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 90
7 more
- 2019Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networkscited by 62
- 2021A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysiscited by 61
- 2019Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classificationcited by 50
- 2021Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTacited by 41
- 2016Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attentioncited by 23
- 2019Syntax-Aware Aspect-Level Sentiment Classification with Proximity-Weighted Convolution Networkcited by 14
- 2021Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classificationcited by 13
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 3; 2024: 2; 2025: 1; 2026: 1.
11 papers.
- 2022A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challengescited by 61
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2021LSA: Modeling Aspect Sentiment Coherency via Local Sentiment Aggregationcited by 7
- 2022PyABSA: A Modularized Framework for Reproducible Aspect-based Sentiment Analysiscited by 4
- 2024Instruct-DeBERTa: A Hybrid Approach for Aspect-based Sentiment Analysis on Textual Reviewscited by 2
- 2022A Framework of Customer Review Analysis Using the Aspect-Based Opinion Mining Approachcited by 1
- 2023A Weak Supervision Approach for Few-Shot Aspect Based Sentimentcited by 1
- 2024A Note on Bias to Completecited by 1
- 2025EmoGRACE: Aspect-based emotion analysis for social media datacited by 1
- 2023Topic Bias in Emotion Classificationcited by 0
- 2026GHI: Graphormer over Conditioned Hypergraph Incidence for Aspect-Based Sentiment Analysiscited by 0
- 2026GHI: Graphormer over Conditioned Hypergraph Incidence for Aspect-Based Sentiment Analysis21 May 2026
- 2025EmoGRACE: Aspect-based emotion analysis for social media data19 Mar 2025
- 2024Instruct-DeBERTa: A Hybrid Approach for Aspect-based Sentiment Analysis on Textual Reviews23 Aug 2024
- 2024A Note on Bias to Complete18 Feb 2024
- 2023Topic Bias in Emotion Classification14 Dec 2023
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Path13 Jun 2023
- 2023A Weak Supervision Approach for Few-Shot Aspect Based Sentiment19 May 2023
- 2022A Framework of Customer Review Analysis Using the Aspect-Based Opinion Mining Approach20 Dec 2022
- 2022PyABSA: A Modularized Framework for Reproducible Aspect-based Sentiment Analysis2 Aug 2022
- 2022A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges2 Mar 2022
- 2021LSA: Modeling Aspect Sentiment Coherency via Local Sentiment Aggregation16 Oct 2021