mlsanityData to 14 Oct 2026

CoSineVerifier: Tool-Augmented Answer Verification for Computation-Oriented Scientific Questions

arXiv 2512.01224 ↗First posted 1 Dec 2025cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Answer verification methods are widely employed in language model training pipelines spanning data curation, evaluation, and reinforcement learning with verifiable rewards (RLVR). While prior work focus on developing unified verifiers applicable across multiple reasoning scenarios, significant challenges remain in computation-oriented scientific domains, such as algebraic equivalence checking and physical constant substitution. In this paper, we introduce model, a tool-augmented verifier that leverages external executors to perform precise computations and symbolic simplifications. model enables robust verification that goes beyond simple semantic matching. We propose a novel two-stage pipeline, which begin with cold-start fine-tuning and followed by multi-turn reinforcement learning with tool integration. Extensive experiments conducted on STEM subjects, general QA, and long-form reasoning tasks demonstrates strong generalization of model. The results shows that the model achieves state-of-the-art performance on VerifyBench-Hard and SCI-Bench. And we also employ our model in RLVR as a reward model, the results show that it consistently outperforms both rubric-based and model-based verifiers on AIME'24 and AIME'25, demonstrating strong potential to enhance reasoning capabilities of LLM. Our model is released at hyperlinkhttps://huggingface.co/Nanbeige/CoSineVerifier-Tool-4Bhttps://huggingface.co/Nanbeige/CoSineVerifier-Tool-4B.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 38 of its 44 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

38 of 44 references.

References · 38

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  9. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  10. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  11. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
  12. 2025Humanity's Last Examcited by 491
26 more
  1. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
  2. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
  3. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  4. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 280
  5. 2025Inference-Time Scaling for Generalist Reward Modelingcited by 239
  6. 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Datacited by 200
  7. 2025ToRL: Scaling Tool-Integrated RLcited by 169
  8. 2025Skywork Open Reasoner 1 Technical Reportcited by 165
  9. 2025SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoningcited by 146
  10. 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 109
  11. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
  12. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 90
  13. 2025NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questionscited by 84
  14. 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 80
  15. 2025JudgeLRM: Large Reasoning Models as a Judgecited by 78
  16. 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 72
  17. 2025Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoningcited by 68
  18. 2025Agent RL Scaling Law: Agent RL with Spontaneous Code Execution for Mathematical Problem Solvingcited by 62
  19. 2025xVerify: Efficient Answer Verifier for Reasoning Model Evaluationscited by 55
  20. 2025CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Rewardcited by 40
  21. 2025Understanding Tool-Integrated Reasoningcited by 38
  22. 2025AgentRM: Enhancing Agent Generalization with Reward Modelingcited by 27
  23. 2025VerifyBench: Benchmarking Reference-based Reward Systems for Large Language Modelscited by 20
  24. 2025R1-Code-Interpreter: LLMs Reason with Code via Supervised and Multi-stage Reinforcement Learningcited by 15
  25. 2025Tool-integrated Reinforcement Learning for Repo Deep Searchcited by 15
  26. 2025SCI-Verifier: Scientific Verifier with Thinkingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reinforcing General Reasoning without Verifiers
  2. 2025VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains
  3. 2026Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR
  4. 2026Beyond Math and Code: Lightweight Corpus-Grounded Process Rewards for Factual Question Answering
  5. 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains
  6. 2026Multilingual Verifier Bias in RLVR: Benchmark, Rollout Diagnosis, and the Cross-Lingual Selection Bottleneck
  7. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMs
  8. 2025RAVR: Reference-Answer-guided Variational Reasoning for Large Language Models