Towards Robust Aspect-based Sentiment Analysis through Non-counterfactual Augmentations
Not on the map. Why?
Abstract (arXiv)
While state-of-the-art NLP models have demonstrated excellent performance for aspect based sentiment analysis (ABSA), substantial evidence has been presented on their lack of robustness. This is especially manifested as significant degradation in performance when faced with out-of-distribution data. Recent solutions that rely on counterfactually augmented datasets show promising results, but they are inherently limited because of the lack of access to explicit causal structure. In this paper, we present an alternative approach that relies on non-counterfactual data augmentation. Our proposal instead relies on using noisy, cost-efficient data augmentations that preserve semantics associated with the target aspect. Our approach then relies on modelling invariances between different versions of the data to improve robustness. A comprehensive suite of experiments shows that our proposal significantly improves upon strong pre-trained baselines on both standard and robustness-specific datasets. Our approach further establishes a new state-of-the-art on the ABSA robustness benchmark and transfers well across domains.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 24 Jun 2023.
Builds on
33 of 42 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
- 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 293
- 2018Gender Bias in Neural Natural Language Processingcited by 210
- 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
- 2020Representation Learning via Invariant Causal Mechanismscited by 197
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
21 more
- 2019BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysiscited by 176
- 2018Invariance, Causality and Robustnesscited by 123
- 2021The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformerscited by 117
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2019It's All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitutioncited by 102
- 2017Interactive Attention Networks for Aspect-Level Sentiment Classificationcited by 91
- 2017Measuring the tendency of CNNs to Learn Surface Statistical Regularitiescited by 87
- 2020Evaluating Saliency Map Explanations for Convolutional Neural Networks: A User Studycited by 86
- 2019Relational Graph Attention Networkscited by 81
- 2021Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Testscited by 77
- 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
- 2019Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classificationcited by 62
- 2019Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networkscited by 62
- 2021Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTacited by 41
- 2021Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Trainingcited by 37
- 2018Extending a Parser to Distant Domains Using a Few Dozen Partially Annotated Examplescited by 34
- 2019Why are Saliency Maps Noisy? Cause of and Solution to Noisy Saliency Mapscited by 34
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysiscited by 30
- 2020Tasty Burgers, Soggy Fries: Probing Aspect Robustness in Aspect-Based Sentiment Analysiscited by 23
- 2021Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classificationcited by 13
- 2021Exploiting Position Bias for Robust Aspect Sentiment Classificationcited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.