Listwise Preference Optimization with Element-wise Confusions for Aspect Sentiment Quad Prediction
On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods
Abstract (arXiv)
Aspect sentiment quad prediction (ASQP) is inherently challenging to predict a structured quadruple with four core sentiment elements, including aspect term (a), aspect category (c), opinion term (o), and sentiment polarity (s). Prior methods relying on marker-based prediction struggle with modeling the intricate relationships among elements and experience sharp performance declines when predicting higher-order elements (e.g., c and s) under standard supervised fine-tuning. To address these limitations, we employ reasoning-based generation to output both the quadruple and a natural language rationale under element prefixes within a unified template, encouraging explicit relational reasoning and interpretability. To further enhance element-wise alignment, we introduce a listwise preference optimization framework for improving structural validity and relational coherence. Specifically, we generate element-wise confusable candidates via syntactic and semantic proximity, then train the model with listwise objectives to prefer the gold candidates over closely competing alternatives. Extensive experiments on four benchmark datasets demonstrate that our framework effectively improves quadruple prediction accuracy and explanation consistency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 19 of its 39 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
19 of 39 references.
Closest ancestors · 2
Same direction, newest first
- 2023Aligning Language Models with Human Preferences via a Bayesian Approach9 Oct
- 2022Training language models to follow instructions with human feedback4 Mar
Other references · 17
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 273
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
- 2019Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysiscited by 123
- 2024Make Your LLM Fully Utilize the Contextcited by 119
- 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 100
- 2023MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Predictioncited by 50
5 more
- 2022Improving Aspect Sentiment Quad Prediction via Template-Order Data Augmentationcited by 30
- 2023Uncertainty-Aware Unlikelihood Learning Improves Generative Aspect Sentiment Quad Predictioncited by 11
- 2024RVISA: Reasoning and Verification for Implicit Sentiment Analysiscited by 9
- 2025DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimizationcited by 5
- 2024BvSP: Broad-view Soft Prompting for Few-Shot Aspect Sentiment Quad Predictioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Dependency Reasoning for Aspect Sentiment Quadruple Prediction
- 2026S2IT: Stepwise Syntax Integration Tuning for Large Language Models in Aspect Sentiment Quad Prediction
- 2024Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction
- 2026STAR-OPD: Structured Aspect-Cascade-Aware On-Policy Reward Distillation for ABSA Quadruple Extraction
- 2021Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysis
- 2024Rethinking ASTE: A Minimalist Tagging Scheme Alongside Contrastive Learning
- 2025Are You Sure You're Positive? Consolidating Chain-of-Thought Agents with Uncertainty Quantification for Aspect-Category Sentiment Analysis
- 2026Large-Scale Aspect-Based Sentiment Analysis with Reasoning-Infused LLMs