mlsanityData to 14 Oct 2026

Pessimistic Verification for Open Ended Math Questions

arXiv 2511.21522 ↗First posted 26 Nov 2025cs.AIcited by 3

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Automatic verification is a critical component in building math-solving agents and reinforcement learning, yet it often falls short in generalizability, performance, and cost-efficiency. Identifying that the primary bottleneck of verification lies in error detection capability, we propose pessimistic verification, a paradigm of agentic workflows that rejects a solution if any of multiple parallel verifiers identifies a flaw. We further introduce progressive pessimistic verification, which employs fine-grained proof decomposition to significantly enhance verification accuracy and efficiency. Our approach surpasses the performance and token efficiency of extended long chain-of-thought (long CoT) and mainstream verification workflows, crucially, our analysis reveals that existing benchmarks underestimate its effectiveness on stronger models due to inherent annotation errors. To further validate the effectiveness of our method, we applied a verification-based solving workflow on the IMO 2025 and MathArena Apex 2025 datasets, where the workflow with progressive pessimistic verification exhibits remarkable improvements in both efficiency and accuracy on highly challenging contest-level math problems with state-of-the-art models. Code is available at https://github.com/THUNLP-MT/pverify.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 19 of its 34 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

19 of 34 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025TTRL: Test-Time Reinforcement Learning22 Apr

Other references · 18

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  3. 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 101
  4. 2025RLPR: Extrapolating RLVR to General Domains without Verifierscited by 85
  5. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
  6. 2025Towards Robust Mathematical Reasoningcited by 73
  7. 2025The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMscited by 64
  8. 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoningcited by 60
  9. 2025Aristotle: IMO-level Automated Theorem Provingcited by 58
  10. 2025Evaluating Scoring Bias in LLM-as-a-Judgecited by 43
  11. 2025Rating Roulette: Self-Inconsistency in LLM-As-A-Judge Frameworkscited by 38
  12. 2025The Open Proof Corpus: A Large-Scale Study of LLM-Generated Mathematical Proofscited by 30
6 more
  1. 2025Hard2Verify: A Step-Level Verification Benchmark for Open-Ended Frontier Mathcited by 22
  2. 2025Direct Reasoning Optimization: Token-Level Reasoning Reflectivity Meets Rubric Gates for Unverifiable Taskscited by 18
  3. 2025Beyond Consensus: Mitigating the Agreeableness Bias in LLM Judge Evaluationscited by 16
  4. 2025Scaling Generative Verifiers For Natural Language Mathematical Proof Verification And Selectioncited by 9
  5. 2025AI Mathematician: Towards Fully Automated Frontier Mathematical Researchcited by 4
  6. 2025RefGrader: Automated Grading of Mathematical Competition Proofs using Agentic Workflowscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification
  2. 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification
  3. 2026AMTFV: Agentic Mathematical Tool-Flow Verification for LLM Self-Correction
  4. 2026FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified?
  5. 2025Heimdall: test-time scaling on the generative verification
  6. 2026Agentic Proving for Program Verification
  7. 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problems
  8. 2026VERIFY-RL: Verifiable Recursive Decomposition for Reinforcement Learning in Mathematical Reasoning