Escaping the Cognitive Well: Efficient Competition Math with Off-the-Shelf Models
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
In the past year, custom and unreleased math reasoning models reached gold medal performance on the International Mathematical Olympiad (IMO). Similar performance was then reported using large-scale inference on publicly available models but at prohibitive costs (e.g., 3000 USD per problem). In this work, we present an inference pipeline that attains best-in-class performance on IMO-style math problems at an average inference cost orders of magnitude below competing methods while using only general-purpose off-the-shelf models. Our method relies on insights about grader failure in solver-grader pipelines, which we call the Cognitive Well (iterative refinement converging to a wrong solution that the solver as well as the pipeline's internal grader consider to be basically correct). Our pipeline addresses these failure modes through conjecture extraction, wherein candidate lemmas are isolated from generated solutions and independently verified alongside their negations in a fresh environment (context detachment). On IMO-ProofBench Advanced (PB-Adv), our pipeline achieves 67.1 percent performance using Gemini 3.0 Pro with an average cost per question of approximately 31 USD. At the time of evaluation, this represented the state-of-the-art on PB-Adv among both public and unreleased models, and more than doubles the success rate of the next best publicly accessible pipeline, all at a fraction of the cost.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 19 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
10 of 19 references.
Closest ancestors · 4
Same direction, newest first
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoning27 Nov
- 2025Towards Robust Mathematical Reasoning3 Nov
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitions29 May
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
Other references · 6
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
- 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
- 2025Rethinking Thinking Tokens: LLMs as Improvement Operatorscited by 21
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 17
- 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 7
- 2026Pseudo-Formalization for Automatic Proof Verificationcited by 4
- 2026OpenDeepThink: Parallel Reasoning via Bradley-Terry Aggregationcited by 3
- 2026AI Alignment via Incentives and Correctioncited by 2
- 2026Self-Trained Verification for Training- and Test-Time Self-Improvementcited by 2
- 2026Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficientlycited by 2
- 2026Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Sciencecited by 1
- 2026Splicing Hints into Reasoning Traces: Learning from Demonstrator Failurescited by 0
- 2026Splicing Hints into Reasoning Traces: Learning from Demonstrator Failures26 Sep 2026
- 2026Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Science14 Sep 2026
- 2026Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficiently22 Jun 2026
- 2026Self-Trained Verification for Training- and Test-Time Self-Improvement28 May 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problems20 May 2026
- 2026Pseudo-Formalization for Automatic Proof Verification19 May 2026
- 2026OpenDeepThink: Parallel Reasoning via Bradley-Terry Aggregation14 May 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
- 2026AI Alignment via Incentives and Correction2 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025AMO-Bench: Large Language Models Still Struggle in High School Math Competitions
- 2024CHAMP: A Competition-level Dataset for Fine-Grained Analyses of LLMs' Mathematical Reasoning Capabilities
- 2026Riemann-Bench: A Benchmark for Moonshot Mathematics
- 2025RIMO: An Easy-to-Evaluate, Hard-to-Solve Olympiad Benchmark for Advanced Mathematical Reasoning
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning dataset
- 2024MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data
- 2026AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models