From Prediction to Justification: Aligning Sentiment Reasoning with Human Rationale via Reinforcement Learning
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
While Aspect-based Sentiment Analysis (ABSA) systems have achieved high accuracy in identifying sentiment polarities, they often operate as "black boxes," lacking the explicit reasoning capabilities characteristic of human affective cognition. Humans do not merely categorize sentiment; they construct causal explanations for their judgments. To bridge this gap, we propose ABSA-R1, a large language model framework designed to mimic this ``reason-before-predict" cognitive process. By leveraging reinforcement learning (RL), ABSA-R1 learns to articulate the why behind the what, generating natural language justifications that ground its sentiment predictions. We introduce a Cognition-Aligned Reward Model (formerly sentiment-aware reward model) that enforces consistency between the generated reasoning path and the final emotional label. Furthermore, inspired by metacognitive monitoring, we implement a performance-driven rejection sampling strategy that selectively targets hard cases where the model's internal reasoning is uncertain or inconsistent. Experimental results on four benchmarks demonstrate that equipping models with this explicit reasoning capability not only enhances interpretability but also yields superior performance in sentiment classification and triplet extraction compared to non-reasoning baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 50 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
30 of 50 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
18 more
- 2024Rule Based Rewards for Language Model Safetycited by 108
- 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 100
- 2021A Unified Generative Framework for Aspect-Based Sentiment Analysiscited by 97
- 2017Interactive Attention Networks for Aspect-Level Sentiment Classificationcited by 91
- 2015Effective LSTMs for Target-Dependent Sentiment Classificationcited by 82
- 2018Aspect Based Sentiment Analysis with Gated Convolutional Networkscited by 65
- 2021A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysiscited by 62
- 2021Learning Span-Level Interactions for Aspect Sentiment Triplet Extractioncited by 60
- 2018A Unified Model for Opinion Target Extraction and Target Sentiment Predictioncited by 56
- 2023MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Predictioncited by 50
- 2013NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweetscited by 33
- 2023InstructABSA: Instruction Learning for Aspect Based Sentiment Analysiscited by 23
- 2019Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classificationcited by 22
- 2021Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLUcited by 22
- 2022Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysiscited by 16
- 2022A Span-level Bidirectional Network for Aspect Sentiment Triplet Extractioncited by 12
- 2024Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Modelscited by 2
- 2024PGSO: Prompt-based Generative Sequence Optimization Network for Aspect-based Sentiment Analysiscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Task Complexity Matters: An Empirical Study of Reasoning in LLMs for Sentiment Analysis
- 2026Large-Scale Aspect-Based Sentiment Analysis with Reasoning-Infused LLMs
- 2026NTDH: Complex Reasoning for Comprehensive Affective Analysis
- 2020Learning Rewards from Linguistic Feedback
- 2023SOUL: Towards Sentiment and Opinion Understanding of Language
- 2021Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysis
- 2025Reasoning Beyond Labels: Measuring LLM Sentiment in Low-Resource, Culturally Nuanced Contexts
- 2025Large language models show fragile cognitive reasoning about human emotions