mlsanityData to 14 Oct 2026

From Prediction to Justification: Aligning Sentiment Reasoning with Human Rationale via Reinforcement Learning

arXiv 2604.13398 ↗First posted 15 Apr 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Audio-language model reasoning

also in 1 more
Abstract (arXiv)

While Aspect-based Sentiment Analysis (ABSA) systems have achieved high accuracy in identifying sentiment polarities, they often operate as "black boxes," lacking the explicit reasoning capabilities characteristic of human affective cognition. Humans do not merely categorize sentiment; they construct causal explanations for their judgments. To bridge this gap, we propose ABSA-R1, a large language model framework designed to mimic this ``reason-before-predict" cognitive process. By leveraging reinforcement learning (RL), ABSA-R1 learns to articulate the why behind the what, generating natural language justifications that ground its sentiment predictions. We introduce a Cognition-Aligned Reward Model (formerly sentiment-aware reward model) that enforces consistency between the generated reasoning path and the final emotional label. Furthermore, inspired by metacognitive monitoring, we implement a performance-driven rejection sampling strategy that selectively targets hard cases where the model's internal reasoning is uncertain or inconsistent. Experimental results on four benchmarks demonstrate that equipping models with this explicit reasoning capability not only enhances interpretability but also yields superior performance in sentiment classification and triplet extraction compared to non-reasoning baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 50 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

30 of 50 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  9. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  10. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  11. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  12. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
18 more
  1. 2024Rule Based Rewards for Language Model Safetycited by 108
  2. 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 100
  3. 2021A Unified Generative Framework for Aspect-Based Sentiment Analysiscited by 97
  4. 2017Interactive Attention Networks for Aspect-Level Sentiment Classificationcited by 91
  5. 2015Effective LSTMs for Target-Dependent Sentiment Classificationcited by 82
  6. 2018Aspect Based Sentiment Analysis with Gated Convolutional Networkscited by 65
  7. 2021A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysiscited by 62
  8. 2021Learning Span-Level Interactions for Aspect Sentiment Triplet Extractioncited by 60
  9. 2018A Unified Model for Opinion Target Extraction and Target Sentiment Predictioncited by 56
  10. 2023MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Predictioncited by 50
  11. 2013NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweetscited by 33
  12. 2023InstructABSA: Instruction Learning for Aspect Based Sentiment Analysiscited by 23
  13. 2019Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classificationcited by 22
  14. 2021Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLUcited by 22
  15. 2022Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysiscited by 16
  16. 2022A Span-level Bidirectional Network for Aspect Sentiment Triplet Extractioncited by 12
  17. 2024Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Modelscited by 2
  18. 2024PGSO: Prompt-based Generative Sequence Optimization Network for Aspect-based Sentiment Analysiscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Task Complexity Matters: An Empirical Study of Reasoning in LLMs for Sentiment Analysis
  2. 2026Large-Scale Aspect-Based Sentiment Analysis with Reasoning-Infused LLMs
  3. 2026NTDH: Complex Reasoning for Comprehensive Affective Analysis
  4. 2020Learning Rewards from Linguistic Feedback
  5. 2023SOUL: Towards Sentiment and Opinion Understanding of Language
  6. 2021Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysis
  7. 2025Reasoning Beyond Labels: Measuring LLM Sentiment in Low-Resource, Culturally Nuanced Contexts
  8. 2025Large language models show fragile cognitive reasoning about human emotions