Enhancing Aspect-based Sentiment Analysis in Tourism Using Large Language Models and Positional Information
Not on the map. Why?
Abstract (arXiv)
Aspect-Based Sentiment Analysis (ABSA) in tourism plays a significant role in understanding tourists' evaluations of specific aspects of attractions, which is crucial for driving innovation and development in the tourism industry. However, traditional pipeline models are afflicted by issues such as error propagation and incomplete extraction of sentiment elements. To alleviate this issue, this paper proposes an aspect-based sentiment analysis model, ACOS_LLM, for Aspect-Category-Opinion-Sentiment Quadruple Extraction (ACOSQE). The model comprises two key stages: auxiliary knowledge generation and ACOSQE. Firstly, Adalora is used to fine-tune large language models for generating high-quality auxiliary knowledge. To enhance model efficiency, Sparsegpt is utilized to compress the fine-tuned model to 50% sparsity. Subsequently, Positional information and sequence modeling are employed to achieve the ACOSQE task, with auxiliary knowledge and the original text as inputs. Experiments are conducted on both self-created tourism datasets and publicly available datasets, Rest15 and Rest16. Results demonstrate the model's superior performance, with an F1 improvement of 7.49% compared to other models on the tourism dataset. Additionally, there is an F1 improvement of 0.05% and 1.06% on the Rest15 and Rest16 datasets, respectively.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 66 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
20 of 66 references.
References · 20
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2020GLU Variants Improve Transformercited by 1,724
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 658
- 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 99
- 2021A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysiscited by 61
- 2022A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challengescited by 61
8 more
- 2024LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Modelcited by 21
- 2019A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extractioncited by 18
- 2020Context-Guided BERT for Targeted Aspect-Based Sentiment Analysiscited by 18
- 2022A Survey on Aspect-Based Sentiment Classificationcited by 18
- 2021Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysiscited by 11
- 2023Adaptive Low Rank Adaptation of Segment Anything to Salient Object Detectioncited by 7
- 2021Arabic aspect based sentiment analysis using bidirectional GRU based modelscited by 3
- 2023Contrastive variational information bottleneck for aspect-based sentiment analysiscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.