mlsanityData to 14 Oct 2026

VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus

arXiv 2608.10665 ↗First posted 11 Aug 2026cs.AI cs.CV cs.GTcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Multimodal large language models often generate reasoning chains containing subtle errors that lead to incorrect answers. Current verification approaches have notable limitations. Existing approaches either require expensive labelled supervision with inconsistent cross-task performance or aggregate scores from multiple sources by simple aggregations, missing a key insight: when these scores disagree, that disagreement itself carries important information about whether a reasoning step is truly valid or not. We formalise this as a coupled scoring problem among disparate, frozen verifiers, interpretable as a coordination game with a unique closed-form equilibrium where agreement signals valid steps while disagreement reveals instability. Towards this end, we propose a training-free domain-agnostic step-wise verification approach we call VERDICT: VERification via Disagreement-Informed Coupled Thresholding. To our knowledge, VERDICT is the first training-free verifier that makes the structure of cross-modal disagreement explicit and actionable. It computes consensus scores through a closed-form solution, enabling both disagreement-aware filtering and stability-conscious ranking of reasoning steps. Evaluated across six benchmarks, method consistently improves over the base model by up to +5.95%, and performs competitively with domain-specific critics that demand extensive supervision, demonstrating that cross-modal agreement provides robust verification signals without task-specific adaptation and Training-Free Verification

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 51 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

27 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Learning to Refine: Self-Refinement of Parallel Reasoning in LLMs27 Aug

Other references · 26

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2025Gemma 3 Technical Reportcited by 1,824
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  5. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  6. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  7. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  8. 2016A Diagram Is Worth A Dozen Imagescited by 804
  9. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  10. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  11. 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
  12. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 357
14 more
  1. 2023Reward Model Ensembles Help Mitigate Overoptimizationcited by 231
  2. 2023Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hackingcited by 200
  3. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
  4. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 139
  5. 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thoughtcited by 121
  6. 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 97
  7. 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
  8. 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verificationcited by 39
  9. 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
  10. 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervisioncited by 31
  11. 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Modelscited by 27
  12. 2024Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Modelscited by 26
  13. 2025Sherlock: Self-Correcting Reasoning in Vision-Language Modelscited by 13
  14. 2025VGent: Visual Grounding via Modular Design for Disentangling Reasoning and Predictioncited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Nash Equilibrium Framework For Training-Free Multimodal Step Verification
  2. 2026A Single Revision Step Improves Token-Efficient LLM Reasoning
  3. 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRM
  4. 2026Beyond Answer Voting: Fine-Grained Correction of LLM Reasoning through Graph Alignment across Sampled Traces
  5. 2026Beyond Final Answers: CRYSTAL Benchmark for Transparent Multimodal Reasoning Evaluation
  6. 2026ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning
  7. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs
  8. 2025VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains