A Nash Equilibrium Framework For Training-Free Multimodal Step Verification
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Multimodal large language models often generate reasoning chains containing subtle errors that lead to incorrect answers. Current verification approaches have notable limitations. Learned critics need extensive labeled data and show inconsistent performance across different tasks. Meanwhile, existing training-free methods simply average scores from different sources, missing a key insight: when these scores disagree, that disagreement itself carries important information about whether a reasoning step is truly valid or not. We propose a training-free verification approach that treats step-wise verification as a coordination problem among specialized judges. We formalize these judges' interaction as a Nash equilibrium game where agreement signals valid steps while disagreement reveals instability. Our method computes equilibrium scores through a closed-form solution, enabling both disagreement-aware filtering and stability-conscious ranking of reasoning steps. Evaluated across six benchmarks, our approach achieves consistent improvements of 2.4% to 5.2% over baseline models and shows competitive performance against learned critics, demonstrating that cross-modal agreement (not just average confidence) provides robust verification signals without task-specific adaptation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 32 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
20 of 32 references.
References · 20
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Visual Instruction Tuningcited by 7,869
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2023Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hackingcited by 200
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 139
8 more
- 2023LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Modelscited by 113
- 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
- 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verificationcited by 39
- 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervisioncited by 31
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Modelscited by 27
- 2024Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Modelscited by 26
- 2025Sherlock: Self-Correcting Reasoning in Vision-Language Modelscited by 13
- 2025VGent: Visual Grounding via Modular Design for Disentangling Reasoning and Predictioncited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus
- 2026A Single Revision Step Improves Token-Efficient LLM Reasoning
- 2026Pencil Puzzle Bench: A Benchmark for Multi-Step Verifiable Reasoning
- 2025VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains
- 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRM
- 2026Beyond Final Answers: CRYSTAL Benchmark for Transparent Multimodal Reasoning Evaluation
- 2026RFEval: Benchmarking Reasoning Faithfulness under Counterfactual Reasoning Intervention in Large Reasoning Models
- 2026When Models Judge Themselves: Unsupervised Self-Evolution for Multimodal Reasoning