mlsanityData to 7 Oct 2026

Re2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics

arXiv 2605.09012 ↗First posted 9 May 2026cs.AIcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Large language models are increasingly capable at closed-world mathematical reasoning, but research assistance also requires source-grounded use of the literature. When a proof reaches a non-trivial step, a useful assistant should determine whether the needed tool (e.g., a lemma) already exists, identify a suitable scholarly source, and verify that its assumptions align with the current proof context. To rigorously evaluate such capabilities, we introduce Re2Math, a benchmark for tool-grounded retrieval from partial mathematical proofs. Each instance is built from a candidate instrumental citation in the proof of a main theorem, with hierarchical context and an optional leakage-controlled anchor hint. We also make the task source-grounded yet citation-agnostic in that any admissible theorem sufficient for the proof transition is accepted. Evaluation uses a release-frozen retrieval artifact, ensuring reproducibility, while the benchmark itself supports automatic, continual expansion with newly constructed instances. On the current benchmark test set, the best fixed-judge ToolAcc reaches 7.0%, despite substantially higher rates of source grounding, indicating that current systems often retrieve valid statements but fail to establish their applicability to the local proof step. By decoupling citation recall, grounding, and proof-gap sufficiency, Re2Math transforms literature-grounded mathematical tool use into a controlled diagnostic task.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 41 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

31 of 41 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models27 Mar
  2. 2025Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluation24 Jan
  3. 2024HARP: A challenging human-annotated math reasoning benchmark11 Dec
  4. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI7 Nov
  5. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models10 Oct

Other references · 26

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  6. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  7. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
  8. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  9. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  10. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  11. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  12. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
14 more
  1. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  2. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
  3. 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
  4. 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
  5. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
  6. 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
  7. 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 80
  8. 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
  9. 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
  10. 2020Citation Recommendation: Approaches and Datasetscited by 36
  11. 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Taskscited by 34
  12. 2025Deep Research Bench: Evaluating AI Web Research Agentscited by 31
  13. 2024A Semantic Search Engine for Mathlib4cited by 30
  14. 2017HolStep: A Machine Learning Dataset for Higher-order Logic Theorem Provingcited by 26

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems
  2. 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness
  3. 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematics
  4. 2026AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
  5. 2026EternalMath: A Living Benchmark of Frontier Mathematics that Evolves with Human Discovery
  6. 2026Semantic Search over 9 Million Mathematical Theorems
  7. 2026TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics
  8. 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification