QED-Nano: Teaching a Tiny Model to Prove Hard Theorems
Not on the map. Why?
Abstract (arXiv)
Proprietary AI systems have recently demonstrated impressive capabilities on complex proof-based problems, with gold-level performance reported at the 2025 International Mathematical Olympiad (IMO). However, the training pipelines behind these systems remain largely undisclosed, and their reliance on large "internal" models and scaffolds makes them expensive to run, difficult to reproduce, and hard to study or improve upon. This raises a central question: can small, open models also be trained to achieve competitive reasoning performance on difficult Olympiad-level math? In this paper, we answer this question by building QED-Nano, a 4B model post-trained for Olympiad-level proofs. Our training recipe has three stages: (1) supervised fine-tuning to imbue good proof-writing styles by distilling from DeepSeek-Math-V2, (2) reinforcement learning (RL) with rubric-based rewards, and (3) expanding RL with a reasoning cache, which decomposes long proofs into iterative summarize-and-refine cycles and enables stronger test-time reasoning. QED-Nano surpasses the proof-generation performance of much larger open models, including Nomos-1 and GPT-OSS-120B, and approaches the performance of proprietary models like Gemini 3 Pro, at a fraction of the inference cost. To support further research on open mathematical reasoning, we release the full QED-Nano pipeline, including the QED-Nano and QED-Nano-SFT models, the FineProofs-SFT and FineProofs-RL datasets, and the training and evaluation code.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
29 of 41 references.
References · 29
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2025Humanity's Last Examcited by 467
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 275
- 2023The False Promise of Imitating Proprietary LLMscited by 254
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 165
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 121
- 2024Common 7B Language Models Already Possess Strong Math Capabilitiescited by 108
17 more
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
- 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
- 2025Proof or Bluff? Evaluating LLMs on 2025 USA Math Olympiadcited by 72
- 2025Towards Robust Mathematical Reasoningcited by 67
- 2025e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMscited by 56
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 43
- 2026Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameterscited by 33
- 2025Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Modelscited by 30
- 2025PipelineRL: Faster On-policy Reinforcement Learning for Long Sequence Generationcited by 29
- 2025The Open Proof Corpus: A Large-Scale Study of LLM-Generated Mathematical Proofscited by 27
- 2025Brains vs. Bytes: Evaluating LLM Proficiency in Olympiad Mathematicscited by 22
- 2025Reliable Fine-Grained Evaluation of Natural Language Math Proofscited by 14
- 2026Reasoning Cache: Continual Improvement Over Long Horizons via Short-Horizon RLcited by 11
- 2025Scaling Generative Verifiers For Natural Language Mathematical Proof Verification And Selectioncited by 8
- 2026Project Aletheia: Verifier-Guided Distillation of Backtracking for Small Language Modelscited by 6
- 2025Solving a Research Problem in Mathematical Statistics with AI Assistancecited by 5
- 2024Lattice-Valued Bottleneck Dualitycited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Recursive Agent Optimizationcited by 4
- 2026Trust the Critic Morecited by 0
- 2026Trust the Critic More30 Sep 2026
- 2026Recursive Agent Optimization7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
- 2025Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Proving
- 2026Riemann-Bench: A Benchmark for Moonshot Mathematics
- 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience
- 2025Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data
- 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning
- 2026Towards Autonomous Mathematics Research