Improving Generative Cross-lingual Aspect-Based Sentiment Analysis with Constrained Decoding
Not on the map. Why?
Abstract (arXiv)
While aspect-based sentiment analysis (ABSA) has made substantial progress, challenges remain for low-resource languages, which are often overlooked in favour of English. Current cross-lingual ABSA approaches focus on limited, less complex tasks and often rely on external translation tools. This paper introduces a novel approach using constrained decoding with sequence-to-sequence models, eliminating the need for unreliable translation tools and improving cross-lingual performance by 5% on average for the most complex task. The proposed method also supports multi-tasking, which enables solving multiple ABSA tasks with a single model, with constrained decoding boosting results by more than 10%. We evaluate our approach across seven languages and six ABSA tasks, surpassing state-of-the-art methods and setting new benchmarks for previously unexplored tasks. Additionally, we assess large language models (LLMs) in zero-shot, few-shot, and fine-tuning scenarios. While LLMs perform poorly in zero-shot and few-shot settings, fine-tuning achieves competitive results compared to smaller multilingual models, albeit at the cost of longer training and inference times. We provide practical recommendations for real-world applications, enhancing the understanding of cross-lingual ABSA methodologies. This study offers valuable insights into the strengths and limitations of cross-lingual ABSA approaches, advancing the state-of-the-art in this challenging research domain.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 44 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
23 of 44 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
- 2020Autoregressive Entity Retrievalcited by 334
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
11 more
- 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
- 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 100
- 2023MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Predictioncited by 50
- 2022Improving Aspect Sentiment Quad Prediction via Template-Order Data Augmentationcited by 30
- 2020Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyondcited by 22
- 2018Joint Aspect and Polarity Classification for Aspect-based Sentiment Analysis with End-to-End Neural Networkscited by 19
- 2019Zero-Shot Cross-Lingual Opinion Target Extractioncited by 11
- 2022CL-XABSA: Contrastive Learning for Cross-lingual Aspect-based Sentiment Analysiscited by 6
- 2025Czech Dataset for Complex Aspect-Based Sentiment Analysis Taskscited by 4
- 2025LLaMA-Based Models for Aspect-Based Sentiment Analysiscited by 3
- 2025Cross-lingual Aspect-Based Sentiment Analysis: A Survey on Tasks, Approaches, and Challengescited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.