mlsanityData to 7 Oct 2026

ResearchMath-14K: Scaling Research-Level Mathematics via Agents

arXiv 2605.28003 ↗First posted 27 May 2026cs.CLcited by 2

On the map: LLM agents and tool use → Educational agents and math problem solving

Abstract (arXiv)

The frontier of mathematics is defined by problems whose solutions are not yet known. However, whether language models can meaningfully engage with such problems without human intervention remains unclear. A major obstacle is the lack of large-scale research-level math datasets. To this end, we introduce ResearchMath-14k, a set of 14,056 problems curated from academic sources via a multi-agent pipeline. ResearchMath-14k spans 11 mathematical domains and ranks above existing math datasets on knowledge, novelty, and procedural difficulty. To our knowledge, it is the largest research-level mathematical problem set available for training. We additionally generate 220K teacher trajectories through targeted prompting, followed by behavioral filtering. Notably, however, generating correct trajectories is nontrivial at this level, and two LLM judges label only 3.7% and 4.3% of sampled ResearchMath training trajectories as correct. Nevertheless, across three model families, full-parameter training on ResearchMath improves performance on graduate- and research-level mathematics benchmarks by 2.1 points over the starting checkpoints. In comparison, training on existing datasets such as DASD and Nemotron-SFT-Math-v4 changes performance by 0.0 and -0.5 points, respectively. Notably, mixing DASD with ResearchMath yields higher scores than token-matched DASD alone on benchmarks covering olympiad short-form (+2.0), graduate- and research-level short-form (+0.8), graduate- and research-level symbolic (+2.6), and proof evaluation (+5.7). Further analysis suggests that research-level mathematical content and greater reasoning diversity may help explain why ResearchMath provides complementary supervision to contemporary datasets. We make ResearchMath-14k publicly available for future works on research-level mathematical reasoning.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 43 of its 106 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

43 of 106 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May

Other references · 42

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2025s1: Simple test-time scalingcited by 1,311
  8. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  9. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  10. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  11. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
  12. 2025Kimi K2: Open Agentic Intelligencecited by 523
30 more
  1. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
  2. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  3. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  4. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  5. 2023Mathematical Capabilities of ChatGPTcited by 263
  6. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
  7. 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Datacited by 194
  8. 2025Agentic Reinforced Policy Optimizationcited by 166
  9. 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 165
  10. 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Datasetcited by 143
  11. 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
  12. 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
  13. 2025NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questionscited by 81
  14. 2024AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modelingcited by 76
  15. 2025AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergycited by 75
  16. 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 56
  17. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 41
  18. 2025The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longercited by 39
  19. 2024HARDMath: A Benchmark Dataset for Challenging Problems in Applied Mathematicscited by 32
  20. 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematicscited by 30
  21. 2025Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluationcited by 29
  22. 2026First Proofcited by 26
  23. 2026Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoningcited by 13
  24. 2026HLE-Verified: A Systematic Verification and Structured Revision of Humanity's Last Examcited by 11
  25. 2025Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thoughtcited by 10
  26. 2026Riemann-Bench: A Benchmark for Moonshot Mathematicscited by 8
  27. 2026LiteResearcher: A Scalable Agentic RL Training Framework for Deep Research Agentcited by 8
  28. 2026Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMscited by 4
  29. 2026QEDBENCH: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofscited by 3
  30. 2026Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Mathcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification
  2. 2026CrowdMath: A Dataset of Crowdsourced Mathematical Research Discussions
  3. 2026RMA: an Agentic System for Research-Level Mathematical Problems
  4. 2026Iteris: Agentic Research Loops for Computational Mathematics
  5. 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier
  6. 2024ControlMath: Controllable Data Generation Promotes Math Generalist Models
  7. 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval
  8. 2025IMProofBench: Benchmarking AI on Research-Level Mathematical Proof Generation