Re2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Large language models are increasingly capable at closed-world mathematical reasoning, but research assistance also requires source-grounded use of the literature. When a proof reaches a non-trivial step, a useful assistant should determine whether the needed tool (e.g., a lemma) already exists, identify a suitable scholarly source, and verify that its assumptions align with the current proof context. To rigorously evaluate such capabilities, we introduce Re2Math, a benchmark for tool-grounded retrieval from partial mathematical proofs. Each instance is built from a candidate instrumental citation in the proof of a main theorem, with hierarchical context and an optional leakage-controlled anchor hint. We also make the task source-grounded yet citation-agnostic in that any admissible theorem sufficient for the proof transition is accepted. Evaluation uses a release-frozen retrieval artifact, ensuring reproducibility, while the benchmark itself supports automatic, continual expansion with newly constructed instances. On the current benchmark test set, the best fixed-judge ToolAcc reaches 7.0%, despite substantially higher rates of source grounding, indicating that current systems often retrieve valid statements but fail to establish their applicability to the local proof step. By decoupling citation recall, grounding, and proof-gap sufficiency, Re2Math transforms literature-grounded mathematical tool use into a controlled diagnostic task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 41 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
31 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models27 Mar
- 2025Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluation24 Jan
- 2024HARP: A challenging human-annotated math reasoning benchmark11 Dec
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI7 Nov
- 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models10 Oct
Other references · 26
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
14 more
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
- 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 80
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2020Citation Recommendation: Approaches and Datasetscited by 36
- 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Taskscited by 34
- 2025Deep Research Bench: Evaluating AI Web Research Agentscited by 31
- 2024A Semantic Search Engine for Mathlib4cited by 30
- 2017HolStep: A Machine Learning Dataset for Higher-order Logic Theorem Provingcited by 26
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems
- 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematics
- 2026AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
- 2026EternalMath: A Living Benchmark of Frontier Mathematics that Evolves with Human Discovery
- 2026Semantic Search over 9 Million Mathematical Theorems
- 2026TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification