mlsanityData to 7 Oct 2026

Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains

arXiv 2512.22545 ↗First posted 27 Dec 2025cs.CV cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 2 more
Abstract (arXiv)

Multimodal LLMs often produce fluent yet unreliable reasoning, exhibiting weak step-to-step coherence and insufficient visual grounding, largely because existing alignment approaches supervise only the final answer while ignoring the reliability of the intermediate reasoning process. We introduce SR-MCR, a lightweight and label-free framework that aligns reasoning by exploiting intrinsic process signals derived directly from model outputs. Five self-referential cues -- semantic alignment, lexical fidelity, non-redundancy, visual grounding, and step consistency -- are integrated into a normalized, reliability-weighted reward that provides fine-grained process-level guidance. A critic-free GRPO objective, enhanced with a confidence-aware cooling mechanism, further stabilizes training and suppresses trivial or overly confident generations. Built on Qwen2.5-VL, SR-MCR improves both answer accuracy and reasoning coherence across a broad set of visual benchmarks; among open-source models of comparable size, SR-MCR-7B achieves state-of-the-art performance with an average accuracy of 81.4%. Ablation studies confirm the independent contributions of each reward term and the cooling module.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 80 references that are in the map. First posted on arXiv 27 Dec 2025.

Builds on

43 of 80 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models9 Dec
  2. 2025CF-VLM:CounterFactual Vision-Language Fine-tuning10 Jun
  3. 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun
  4. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  5. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  6. 2025Kimi-VL Technical Report10 Apr

Other references · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  8. 2023Let's Verify Step by Stepcited by 3,598
  9. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  10. 2015Trust Region Policy Optimizationcited by 2,503
  11. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  12. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
25 more
  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  2. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  3. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  4. 2016A Diagram Is Worth A Dozen Imagescited by 793
  5. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
  6. 2019Neural Text Generation with Unlikelihood Trainingcited by 489
  7. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  8. 2023Analyzing and Mitigating Object Hallucination in Large Vision-Language Modelscited by 314
  9. 2023M3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuningcited by 126
  10. 2025Kwai Keye-VL Technical Reportcited by 47
  11. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
  12. 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 30
  13. 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 29
  14. 2025Failure-Driven Workflow Refinementcited by 19
  15. 2025Hybrid Token Compression for Vision-Language Modelscited by 19
  16. 2025Kolmogorov-Arnold Fourier Networkscited by 18
  17. 2025Learning Dynamics of VLM Finetuningcited by 17
  18. 2025Top-Down Semantic Refinement for Image Captioningcited by 16
  19. 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
  20. 2025SAIL-VL2 Technical Reportcited by 14
  21. 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
  22. 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
  23. 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12
  24. 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Modelscited by 11
  25. 2025STORM: Search-Guided Generative World Models for Robotic Manipulationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025StructVRM: Aligning Multimodal Reasoning with Structured and Verifiable Reward Models
  2. 2026PaLMR: Towards Faithful Visual Reasoning via Multimodal Process Alignment
  3. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  4. 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Models
  5. 2026CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
  6. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning
  7. 2026Reinforcing Multimodal Reasoning via Token-Level Perception-Grounded Advantage Estimation
  8. 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking