BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
Aspect-based sentiment analysis (ABSA) aims to associate a text with a set of aspects and infer their respective sentimental polarities. State-of-the-art approaches are built on fine-tuning pre-trained language models, focusing on learning aspect-specific representations from the corpus. However, aspects are often expressed implicitly, making implicit mapping challenging without sufficient labeled examples, which may be scarce in real-world scenarios. This paper proposes a unified framework to address aspect categorization and aspect-based sentiment subtasks. We introduce a mechanism to construct an auxiliary-sentence for the implicit aspect using the corpus's semantic information. We then encourage BERT to learn aspect-specific representation in response to this auxiliary-sentence, not the aspect itself. We evaluate our approach on real benchmark datasets for both ABSA and Targeted-ABSA tasks. Our experiments show that it consistently achieves state-of-the-art performance in aspect categorization and aspect-based sentiment across all datasets, with considerable improvement margins. The BERT-ASC code is available at https://github.com/amurtadha/BERT-ASC.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 20 of its 67 references that are in the map. First posted on arXiv 22 Mar 2022.
Builds on
20 of 67 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
- 2019BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysiscited by 176
- 2019To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Taskscited by 167
- 2019Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentencecited by 121
- 2016Tracking the World State with Recurrent Entity Networkscited by 51
8 more
- 2021Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTacited by 41
- 2016SentiHood: Targeted Aspect Based Sentiment Analysis Dataset for Urban Neighbourhoodscited by 32
- 2020Adversarial Training for Aspect-Based Sentiment Analysis with BERTcited by 26
- 2020Context-Guided BERT for Targeted Aspect-Based Sentiment Analysiscited by 18
- 2020Improving BERT Performance for Aspect-Based Sentiment Analysiscited by 15
- 2019Aspect Category Detection via Topic-Attention Networkcited by 13
- 2019A Variational Approach to Weakly Supervised Document-Level Multi-Aspect Sentiment Classificationcited by 5
- 2018Recurrent Entity Networks with Delayed Memory Update for Targeted Aspect-based Sentiment Analysiscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 3.
4 papers.
- 2024AlcLaM: Arabic Dialectal Language Model18 Jul 2024
- 2024Supervised Gradual Machine Learning for Aspect Category Detection8 Apr 2024
- 2024Naive Bayes-based Context Extension for Large Language Models26 Mar 2024
- 2023Rank-Aware Negative Training for Semi-Supervised Text Classification13 Jun 2023