TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRM
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have achieved impressive performances in mathematical reasoning, yet they remain vulnerable to visual hallucinations and logical inconsistencies that standard outcome-based supervision fails to mitigate. While Process Reward Models (PRMs) promise step-by-step verification, current approaches typically operate as scalar scorers or generative critics that suffer from sycophancy, blindly validating the flawed hypotheses rather than grounding them in visual reality. To bridge this gap, we introduce TIM-PRM (Tool-Integrated Multimodal PRM), a novel agentic framework that transforms verification from a passive classification task into an active, tool-augmented investigation. TIM-PRM is trained to explicitly plan verification strategies and utilizes a mechanism of Independent Question Asking to query evidence via external tools, effectively decoupling verification from the reasoning context to eliminate confirmation bias. We instantiate this method by curating a high-quality dataset of tool-integrated verification trajectories. Extensive experiments on VisualProcessBench demonstrate that our 8B parameter model surpasses existing open-source multimodal PRMs, significantly outperforming much larger models like Qwen2.5-72B and InternVL-78B, while offering interpretable insights into the verification process.
Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 30 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
27 of 30 references.
Closest ancestors · 9
Same direction, newest first
- 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
- 2025GM-PRM: A Generative Multimodal Process Reward Model for Multimodal Mathematical Reasoning6 Aug
- 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervision19 May
- 2025Skywork-VL Reward: An Effective Reward Model for Multimodal Understanding and Reasoning12 May
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
- 2025InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model21 Jan
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
Other references · 18
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2024GPT-4o System Cardcited by 4,536
- 2023Let's Verify Step by Stepcited by 3,672
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,197
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,692
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,057
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,070
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 580
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 407
- 2024ProcessBench: Identifying Process Errors in Mathematical Reasoningcited by 280
- 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 132
6 more
- 2025MM-RLHF: The Next Step Forward in Multimodal LLM Alignmentcited by 81
- 2024Process Reward Model with Q-Value Rankingscited by 79
- 2025R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learningcited by 65
- 2024Unveiling the Ignorance of MLLMs: Seeing Clearly, Answering Incorrectlycited by 29
- 2025Athena: Enhancing Multimodal Reasoning with Data-efficient Process Reward Modelscited by 16
- 2025VRPRM: Process Reward Modeling via Visual Reasoningcited by 11
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Grounding the Score: Explicit Visual Premise Verification for Reliable Vision-Language Process Reward Modelscited by 4
- 2026KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scalingcited by 4
- 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learningcited by 3
- 2026SCI-PRM: A Tool Aware Process Reward Model for Scientific Reasoning Verificationcited by 2
- 2026Training Data Efficiency in Multimodal Process Reward Modelscited by 1
- 2026StainFlow: Entity-Stain Tracking and Evidence Linking for Process Rewards in GUI Agentscited by 1
- 2026VeriBound: PAC-Bayesian Generalization Bounds for Process Reward Models Trained with Formal Verification Toolscited by 1
- 2026Test-Time Scaling for Small VLMs on Multilingual Visual MCQcited by 1
- 2026Test-Time Scaling for Small VLMs on Multilingual Visual MCQ10 Jul 2026
- 2026KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling10 Jul 2026
- 2026VeriBound: PAC-Bayesian Generalization Bounds for Process Reward Models Trained with Formal Verification Tools17 Jun 2026
- 2026StainFlow: Entity-Stain Tracking and Evidence Linking for Process Rewards in GUI Agents5 Jun 2026
- 2026SCI-PRM: A Tool Aware Process Reward Model for Scientific Reasoning Verification3 Jun 2026
- 2026Grounding the Score: Explicit Visual Premise Verification for Reliable Vision-Language Process Reward Models17 Mar 2026
- 2026Training Data Efficiency in Multimodal Process Reward Models4 Feb 2026
- 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learning28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Unlocking Multimodal Mathematical Reasoning via Process Reward Model
- 2025PRM-BAS: Enhancing Multimodal Reasoning through PRM-guided Beam Annealing Search
- 2025Training Vision-Language Process Reward Models for Test-Time Scaling in Multimodal Reasoning: Key Insights and Lessons Learned
- 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification
- 2025MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains
- 2025StructVRM: Aligning Multimodal Reasoning with Structured and Verifiable Reward Models
- 2025Seeing and Reasoning with Confidence: Supercharging Multimodal LLMs with an Uncertainty-Aware Agentic Framework