mlsanityData to 7 Oct 2026

SCI-PRM: A Tool Aware Process Reward Model for Scientific Reasoning Verification

arXiv 2606.04579 ↗First posted 3 Jun 2026cs.AIcited by 1

On the map: LLM reasoning → Reinforcement learning for reasoning

also in 1 more
Abstract (arXiv)

While Process Reward Models (PRMs) have achieved remarkable success in mathematical reasoning, their application in complex scientific domains-such as biology, chemistry, and physics remains largely unexplored. Scientific problems demand not only logical rigor but also factual consistency and the precise usage of domain-specific tools, areas where current models often suffer from hallucinations and lack of verification. In this paper, we first construct SCIPRM70K, a large-scale dataset featuring Chain-of-Tool trajectories that explicitly interleave reasoning with the execution of scientific tools. Building upon this, we train an efficient reward model called Sci-PRM to provide fine-grained supervision on tool selection, execution accuracy, and result interpretation at each step in one inference. Experiments demonstrate that Sci-PRM significantly enhances foundation models in two key aspects: (1) it enables effective test-time scaling via Best-of-N selection; and (2) when integrated into Reinforcement Learning, it serves as a dense reward signal that mitigates the critical issue of advantage disappearance, allowing the model to break through existing performance ceilings.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 63 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

41 of 63 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025AgentPRM: Process Reward Models for LLM Agents via Step-Wise Promise and Progress11 Nov
  2. 2025Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards9 Oct
  3. 2025ToolRM: Outcome Reward Models for Tool-Calling Large Language Models15 Sep
  4. 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergy2 Jul
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
  6. 2022Solving math word problems with process- and outcome-based feedback25 Nov
  7. 2017Proximal Policy Optimization Algorithms20 Jul

Other references · 34

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
  7. 2025OpenAI GPT-5 System Cardcited by 910
  8. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  9. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
  10. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  11. 2025Seed1.5-VL Technical Reportcited by 367
  12. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
22 more
  1. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
  2. 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 67
  3. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 49
  4. 2025Earth-Agent: Unlocking the Full Landscape of Earth Observation with Agentscited by 42
  5. 2024Are large language models superhuman chemists?cited by 34
  6. 2024Code Comprehension then Auditing for Unsupervised LLM Evaluationcited by 31
  7. 2025Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflowscited by 25
  8. 2026Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scalecited by 25
  9. 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discoverycited by 24
  10. 2025BaseReward: A Strong Baseline for Multimodal Reward Modelcited by 15
  11. 2025BioProBench: A Corpus and Benchmark for Biological Protocol Reasoning in Autonomous Sciencecited by 14
  12. 2025CompassJudger-2: Towards Generalist Judge Model via Verifiable Rewardscited by 11
  13. 2025Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoningcited by 11
  14. 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMscited by 9
  15. 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRMcited by 8
  16. 2026OpenEarth-Agent: From Tool Calling to Tool Creation for Open-Environment Earth Observationcited by 7
  17. 2025SCI-Verifier: Scientific Verifier with Thinkingcited by 6
  18. 2025ATLAS: A High-Difficulty, Multidisciplinary Benchmark for Frontier Scientific Reasoningcited by 5
  19. 2025PORTool: Importance-Aware Policy Optimization with Rewarded Tree for Multi-Tool-Integrated Reasoningcited by 4
  20. 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligencecited by 3
  21. 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
  22. 2026SciDataCopilot: An Agentic Data Preparation Framework for AGI-driven Scientific Discoverycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025R-PRM: Reasoning-Driven Process Reward Modeling
  2. 2025From Mathematical Reasoning to Code: Generalization of Process Reward Models in Test-Time Scaling
  3. 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis
  4. 2025Athena: Enhancing Multimodal Reasoning with Data-efficient Process Reward Models
  5. 2025Process Reward Models That Think
  6. 2025PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models
  7. 2023Let's reward step by step: Step-Level reward model as the Navigators for Reasoning
  8. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoning