mlsanityData to 7 Oct 2026

Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification

arXiv 1908.11860 ↗First posted 30 Aug 2019cs.CLcited by 62

Not on the map. Why?

Abstract (arXiv)

Aspect-Target Sentiment Classification (ATSC) is a subtask of Aspect-Based Sentiment Analysis (ABSA), which has many applications e.g. in e-commerce, where data and insights from reviews can be leveraged to create value for businesses and customers. Recently, deep transfer-learning methods have been applied successfully to a myriad of Natural Language Processing (NLP) tasks, including ATSC. Building on top of the prominent BERT language model, we approach ATSC using a two-step procedure: self-supervised domain-specific BERT language model finetuning, followed by supervised task-specific finetuning. Our findings on how to best exploit domain-specific language model finetuning enable us to produce new state-of-the-art performance on the SemEval 2014 Task 4 restaurants dataset. In addition, to explore the real-world robustness of our models, we perform cross-domain evaluation. We show that a cross-domain adapted BERT language model performs significantly better than strong baseline models like vanilla BERT-base and XLNet-base. Finally, we conduct a case study to interpret model prediction errors.

Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Aug 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 19; 2022: 14; 2023: 16; 2024: 6; 2025: 5; 2026: 2.

62 papers.

Sort:

By area:

  1. 2023Reasoning Implicit Sentiment with Chain-of-Thought Promptingcited by 79
  2. 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
  3. 2022A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challengescited by 61
  4. 2021Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Trainingcited by 37
  5. 2021Efficient Domain Adaptation of Language Models via Adaptive Tokenizationcited by 34
  6. 2021Efficient Hierarchical Domain Adaptation for Pretrained Language Modelscited by 32
  7. 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
  8. 2022Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnairescited by 26
  9. 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 22
  10. 2021Open Aspect Target Sentiment Classification with Natural Language Promptscited by 20
  11. 2022Causal Intervention Improves Implicit Sentiment Analysiscited by 16
  12. 2021Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classificationcited by 13
38 more
  1. 2022Cluster & Tune: Boost Cold Start Performance in Text Classificationcited by 13
  2. 2023The Sentiment Problem: A Critical Survey towards Deconstructing Sentiment Analysiscited by 12
  3. 2021To Share or not to Share: Predicting Sets of Sources for Model Transfer Learningcited by 11
  4. 2021Exploiting Position Bias for Robust Aspect Sentiment Classificationcited by 9
  5. 2022DAME: Domain Adaptation for Matching Entitiescited by 9
  6. 2024RVISA: Reasoning and Verification for Implicit Sentiment Analysiscited by 8
  7. 2021Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviewscited by 7
  8. 2023Adapting Foundation Models for Information Synthesis of Wireless Communication Specificationscited by 7
  9. 2023Aspect-Based Sentiment Analysis with Explicit Sentiment Augmentationscited by 7
  10. 2024DALLMi: Domain Adaption for LLM-based Multi-label Classifiercited by 7
  11. 2022Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysiscited by 6
  12. 2022CliMedBERT: A Pre-trained Language Model for Climate and Health-related Textcited by 5
  13. 2023Improving Aspect-Based Sentiment with End-to-End Semantic Role Labeling Modelcited by 5
  14. 2023How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Studycited by 4
  15. 2021If you've got it, flaunt it: Making the most of fine-grained sentiment annotationscited by 3
  16. 2021Towards Target-dependent Sentiment Classification in News Articlescited by 3
  17. 2021AR-BERT: Aspect-relation enhanced Aspect-level Sentiment Classification with Multi-modal Explanationscited by 3
  18. 2022Dynamically Refined Regularization for Improving Cross-corpora Hate Speech Detectioncited by 3
  19. 2023A Novel Counterfactual Data Augmentation Method for Aspect-Based Sentiment Analysiscited by 3
  20. 2024Aspect-Based Sentiment Analysis Techniques: A Comparative Studycited by 3
  21. 2024BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognitioncited by 3
  22. 2021Re-Evaluating GermEval17 Using German Pre-Trained Language Modelscited by 2
  23. 2021Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignmentcited by 2
  24. 2022Evaluating BERT-based Pre-training Language Models for Detecting Misinformationcited by 2
  25. 2023Towards Robust Aspect-based Sentiment Analysis through Non-counterfactual Augmentationscited by 2
  26. 2025Enhanced Multimodal Aspect-Based Sentiment Analysis by LLM-Generated Rationalescited by 2
  27. 2022Multi-Domain Targeted Sentiment Analysiscited by 1
  28. 2022Task Transfer and Domain Adaptation for Zero-Shot Question Answeringcited by 1
  29. 2023Document-Level Supervision for Multi-Aspect Sentiment Analysis Without Fine-grained Labelscited by 1
  30. 2023Content-Localization based System for Analyzing Sentiment and Hate Behaviors in Low-Resource Dialectal Arabic: English to Levantine and Gulfcited by 1
  31. 2024Aspect-based Sentiment Evaluation of Chess Moves (ASSESS): an NLP-based Method for Evaluating Chess Strategies from Textbookscited by 1
  32. 2021An Empirical Study on Measuring the Similarity of Sentential Arguments with Language Model Domain Adaptationcited by 0
  33. 2021Explicit Interaction Network for Aspect Sentiment Triplet Extractioncited by 0
  34. 2021Position-based Contributive Embeddings for Aspect-Based Sentiment Analysiscited by 0
  35. 2021Human-in-the-Loop Disinformation Detection: Stance, Sentiment, or Something Else?cited by 0
  36. 2022CS-UM6P at SemEval-2022 Task 6: Transformer-based Models for Intended Sarcasm Detection in English and Arabiccited by 0
  37. 2022Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTacited by 0
  38. 2023DFB: A Data-Free, Low-Budget, and High-Efficacy Clean-Label Backdoor Attackcited by 0

50 most cited of 62 All 62 (JSON)