C2F-Thinker: Coarse-to-Fine Reasoning with Hint-Guided Reinforcement Learning for Multimodal Sentiment Analysis
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Multimodal sentiment analysis aims to integrate textual, acoustic, and visual information for deep emotional understanding. Despite the progress of multimodal large language models (MLLMs) via supervised fine-tuning, their "black-box" nature hinders interpretability. While Chain-of-Thought (CoT) reasoning offers a potential remedy, it is constrained by high manual annotation costs and the inherent challenges of reinforcement learning (RL), such as reward sparsity and low exploration efficiency on hard samples. This paper presents C2F-Thinker, a framework that harmonizes coarse-to-fine structured reasoning with hint-guided RL through a two-stage progressive training pipeline. In the first stage, we conduct cold-start supervised fine-tuning using high-quality CoT data distilled from a larger teacher model, consisting of three distinct phases: polarity judgment, intermediate analysis, and fine-grained scoring. This equips the base model with a structured emotional reasoning paradigm. In the second stage, we introduce a hint-guided Group Relative Policy Optimization (GRPO) algorithm. By injecting correct initial polarity predictions as hints during the sampling process, the model is guided toward accurate reasoning paths, effectively mitigating cascading errors and enhancing the utilization of hard samples. Furthermore, a multi-faceted reward function incorporating classification, regression, and formatting constraints is designed to refine prediction accuracy while preserving interpretability. Experimental results demonstrate that C2F-Thinker achieves competitive performance on fine-grained sentiment regression tasks while significantly outperforming baselines in cross-domain generalization. This highlights its potential in building trustworthy and robust sentiment analysis systems for real-world applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 31 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
18 of 31 references.
Closest ancestors · 2
Same direction, newest first
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Survey29 Sep
- 2025Qwen2.5-Omni Technical Report26 Mar
Other references · 16
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2025Qwen3-Omni Technical Reportcited by 497
- 2023PandaGPT: One Model To Instruction-Follow Them Allcited by 334
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
- 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 60
- 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuningcited by 44
- 2025AffectGPT-R1: Leveraging Reinforcement Learning for Open-Vocabulary Multimodal Emotion Recognitioncited by 15
4 more
- 2025Can Large Language Models Help Multimodal Language Analysis? MMLA: A Comprehensive Benchmarkcited by 9
- 2025GenCLS++: Pushing the Boundaries of Generative Classification in LLMs Through Comprehensive SFT and RL Studies Across Diverse Datasetscited by 6
- 2025Multimodal Large Language Models for End-to-End Affective Computing: Benchmarking and Boosting with Generative Knowledge Promptingcited by 3
- 2024Exploring Large Language Models for Multimodal Sentiment Analysis: Challenges, Benchmarks, and Future Directionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Emotion-o1: Adaptive Long Reasoning for Emotion Understanding in LLMs
- 2026MER-R1: Multimodal Emotion Reasoning via Slow-Fast Thinking Synergy
- 2026EMO-R3: Reflective Reinforcement Learning for Emotional Reasoning in Multimodal Large Language Models
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2026Follow the Clues, Frame the Truth: Hybrid-evidential Deductive Reasoning in Open-Vocabulary Multimodal Emotion Recognition
- 2026Entropy-Guided Data-Efficient Training for Multimodal Reasoning Reward Models
- 2025Learning What to Attend First: Modality-Importance-Guided Reasoning for Reliable Multimodal Emotion Understanding
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning