mlsanityData to 7 Oct 2026

Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa

arXiv 2104.04986 ↗First posted 11 Apr 2021cs.CLcited by 41

Not on the map. Why?

Abstract (arXiv)

Aspect-based Sentiment Analysis (ABSA), aiming at predicting the polarities for aspects, is a fine-grained task in the field of sentiment analysis. Previous work showed syntactic information, e.g. dependency trees, can effectively improve the ABSA performance. Recently, pre-trained models (PTMs) also have shown their effectiveness on ABSA. Therefore, the question naturally arises whether PTMs contain sufficient syntactic information for ABSA so that we can obtain a good ABSA model only based on PTMs. In this paper, we firstly compare the induced trees from PTMs and the dependency parsing trees on several popular models for the ABSA task, showing that the induced tree from fine-tuned RoBERTa (FT-RoBERTa) outperforms the parser-provided tree. The further analysis experiments reveal that the FT-RoBERTa Induced Tree is more sentiment-word-oriented and could benefit the ABSA task. The experiments also show that the pure RoBERTa-based model can outperform or approximate to the previous SOTA performances on six datasets across four languages since it implicitly incorporates the task-oriented syntactic information.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 11 Apr 2021.

Builds on

25 of 48 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
  6. 2019Designing and Interpreting Probes with Control Taskscited by 608
  7. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  8. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  9. 2019Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentencecited by 121
  10. 2020Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERTcited by 109
  11. 2020Relational Graph Attention Network for Aspect-based Sentiment Analysiscited by 104
  12. 2017Interactive Attention Networks for Aspect-Level Sentiment Classificationcited by 91
13 more
  1. 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 90
  2. 2015Effective LSTMs for Target-Dependent Sentiment Classificationcited by 82
  3. 2016Aspect Level Sentiment Classification with Deep Memory Networkcited by 82
  4. 2018Aspect Based Sentiment Analysis with Gated Convolutional Networkscited by 65
  5. 2019Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networkscited by 62
  6. 2020SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysiscited by 54
  7. 2018Transformation Networks for Target-Oriented Sentiment Classificationcited by 47
  8. 2019Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networkscited by 39
  9. 2016A Hierarchical Model of Reviews for Aspect-based Sentiment Analysiscited by 21
  10. 2019Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysiscited by 16
  11. 2017Learning to Attend via Word-Aspect Associative Fusion for Aspect-based Sentiment Analysiscited by 14
  12. 2019Syntax-Aware Aspect-Level Sentiment Classification with Proximity-Weighted Convolution Networkcited by 14
  13. 2018Learning to Represent Bilingual Dictionariescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 9; 2022: 15; 2023: 9; 2024: 4; 2025: 2; 2026: 2.

41 papers.

Sort:

  1. 2021A Unified Generative Framework for Various NER Subtaskscited by 141
  2. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
  3. 2022A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challengescited by 61
  4. 2021ExplainaBoard: An Explainable Leaderboard for NLPcited by 50
  5. 2021Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Trainingcited by 37
  6. 2022Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsingcited by 30
  7. 2022Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysiscited by 16
  8. 2022Causal Intervention Improves Implicit Sentiment Analysiscited by 16
  9. 2022A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysiscited by 12
  10. 2021Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extractioncited by 11
  11. 2023Sentiment Analysis through LLM Negotiationscited by 11
  12. 2021Exploiting Position Bias for Robust Aspect Sentiment Classificationcited by 9
29 more
  1. 2021BERT4GCN: Using BERT Intermediate Layers to Augment GCN for Aspect-based Sentiment Classificationcited by 7
  2. 2021LSA: Modeling Aspect Sentiment Coherency via Local Sentiment Aggregationcited by 7
  3. 2023Aspect-Based Sentiment Analysis with Explicit Sentiment Augmentationscited by 7
  4. 2022Which side are you on? Insider-Outsider classification in conspiracy-theoretic social mediacited by 4
  5. 2022BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysiscited by 4
  6. 2022PyABSA: A Modularized Framework for Reproducible Aspect-based Sentiment Analysiscited by 4
  7. 2023SynGen: A Syntactic Plug-and-play Module for Generative Aspect-based Sentiment Analysiscited by 4
  8. 2023MEMD-ABSA: A Multi-Element Multi-Domain Dataset for Aspect-Based Sentiment Analysiscited by 4
  9. 2023RDGCN: Reinforced Dependency Graph Convolutional Network for Aspect-based Sentiment Analysiscited by 4
  10. 2021AR-BERT: Aspect-relation enhanced Aspect-level Sentiment Classification with Multi-modal Explanationscited by 3
  11. 2023A Novel Counterfactual Data Augmentation Method for Aspect-Based Sentiment Analysiscited by 3
  12. 2024Aspect-Based Sentiment Analysis Techniques: A Comparative Studycited by 3
  13. 2022Target-oriented Sentiment Classification with Sequential Cross-modal Semantic Graphcited by 2
  14. 2022Structural Bias for Aspect Sentiment Triplet Extractioncited by 2
  15. 2022An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Taskscited by 2
  16. 2023Towards Robust Aspect-based Sentiment Analysis through Non-counterfactual Augmentationscited by 2
  17. 2024Instruct-DeBERTa: A Hybrid Approach for Aspect-based Sentiment Analysis on Textual Reviewscited by 2
  18. 2022Multi-Domain Targeted Sentiment Analysiscited by 1
  19. 2022BootAug: Boosting Text Augmentation via Hybrid Instance Filtering Frameworkcited by 1
  20. 2023Contrastive variational information bottleneck for aspect-based sentiment analysiscited by 1
  21. 2023Perturbation-based Self-supervised Attention for Attention Bias in Text Classificationcited by 1
  22. 2025Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysiscited by 1
  23. 2021Extending the Abstraction of Personality Types based on MBTI with Machine Learning and Natural Language Processingcited by 0
  24. 2022LySACoru~na at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools for Sentiment Analysis as Semantic Dependency Parsingcited by 0
  25. 2022Syntactic Inductive Biases for Deep Learning Methodscited by 0
  26. 2024Leveraging Grammar Induction for Language Understanding and Generationcited by 0
  27. 2025Time Is Effort: Estimating Human Post-Editing Time for Grammar Error Correction Tool Evaluationcited by 0
  28. 2026GHI: Graphormer over Conditioned Hypergraph Incidence for Aspect-Based Sentiment Analysiscited by 0
  29. 2026Aspect-Based Sentiment Evolution and its Correlation with Review Rounds in Multi-Round Peer Reviews: A Deep Learning Approachcited by 0