LLaMA-Based Models for Aspect-Based Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
While large language models (LLMs) show promise for various tasks, their performance in compound aspect-based sentiment analysis (ABSA) tasks lags behind fine-tuned models. However, the potential of LLMs fine-tuned for ABSA remains unexplored. This paper examines the capabilities of open-source LLMs fine-tuned for ABSA, focusing on LLaMA-based models. We evaluate the performance across four tasks and eight English datasets, finding that the fine-tuned Orca~2 model surpasses state-of-the-art results in all tasks. However, all models struggle in zero-shot and few-shot scenarios compared to fully fine-tuned ones. Additionally, we conduct error analysis to identify challenges faced by fine-tuned models.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
14 of 30 references.
References · 14
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2021True Few-Shot Learning with Language Modelscited by 344
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
- 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
- 2019Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysiscited by 123
- 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 100
- 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 91
- 2019An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysiscited by 52
- 2023MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Predictioncited by 50
2 more
Built on by
Citing papers per year: 2025: 3.
3 papers.
- 2025Advancing Cross-lingual Aspect-Based Sentiment Analysis with LLMs and Constrained Decoding for Sequence-to-Sequence Modelscited by 3
- 2025Cross-lingual Aspect-Based Sentiment Analysis: A Survey on Tasks, Approaches, and Challengescited by 1
- 2025Improving Generative Cross-lingual Aspect-Based Sentiment Analysis with Constrained Decodingcited by 1
- 2025Improving Generative Cross-lingual Aspect-Based Sentiment Analysis with Constrained Decoding14 Aug 2025
- 2025Advancing Cross-lingual Aspect-Based Sentiment Analysis with LLMs and Constrained Decoding for Sequence-to-Sequence Models14 Aug 2025
- 2025Cross-lingual Aspect-Based Sentiment Analysis: A Survey on Tasks, Approaches, and Challenges13 Aug 2025