ResearchMath-14K: Scaling Research-Level Mathematics via Agents
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
The frontier of mathematics is defined by problems whose solutions are not yet known. However, whether language models can meaningfully engage with such problems without human intervention remains unclear. A major obstacle is the lack of large-scale research-level math datasets. To this end, we introduce ResearchMath-14k, a set of 14,056 problems curated from academic sources via a multi-agent pipeline. ResearchMath-14k spans 11 mathematical domains and ranks above existing math datasets on knowledge, novelty, and procedural difficulty. To our knowledge, it is the largest research-level mathematical problem set available for training. We additionally generate 220K teacher trajectories through targeted prompting, followed by behavioral filtering. Notably, however, generating correct trajectories is nontrivial at this level, and two LLM judges label only 3.7% and 4.3% of sampled ResearchMath training trajectories as correct. Nevertheless, across three model families, full-parameter training on ResearchMath improves performance on graduate- and research-level mathematics benchmarks by 2.1 points over the starting checkpoints. In comparison, training on existing datasets such as DASD and Nemotron-SFT-Math-v4 changes performance by 0.0 and -0.5 points, respectively. Notably, mixing DASD with ResearchMath yields higher scores than token-matched DASD alone on benchmarks covering olympiad short-form (+2.0), graduate- and research-level short-form (+0.8), graduate- and research-level symbolic (+2.6), and proof evaluation (+5.7). Further analysis suggests that research-level mathematical content and greater reasoning diversity may help explain why ResearchMath provides complementary supervision to contemporary datasets. We make ResearchMath-14k publicly available for future works on research-level mathematical reasoning.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 43 of its 106 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
43 of 106 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Let's Verify Step by Stepcited by 3,598
- 2025s1: Simple test-time scalingcited by 1,311
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
- 2025Kimi K2: Open Agentic Intelligencecited by 523
30 more
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2023Mathematical Capabilities of ChatGPTcited by 263
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
- 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Datacited by 194
- 2025Agentic Reinforced Policy Optimizationcited by 166
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 165
- 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Datasetcited by 143
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
- 2025NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questionscited by 81
- 2024AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modelingcited by 76
- 2025AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergycited by 75
- 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 56
- 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 41
- 2025The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longercited by 39
- 2024HARDMath: A Benchmark Dataset for Challenging Problems in Applied Mathematicscited by 32
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematicscited by 30
- 2025Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluationcited by 29
- 2026First Proofcited by 26
- 2026Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoningcited by 13
- 2026HLE-Verified: A Systematic Verification and Structured Revision of Humanity's Last Examcited by 11
- 2025Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thoughtcited by 10
- 2026Riemann-Bench: A Benchmark for Moonshot Mathematicscited by 8
- 2026LiteResearcher: A Scalable Agentic RL Training Framework for Deep Research Agentcited by 8
- 2026Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMscited by 4
- 2026QEDBENCH: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofscited by 3
- 2026Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Mathcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026VALG: An Agentic System for ML Theory Researchcited by 1
- 2026OpenBioRQ: Unsolved Biomedical Research Questions for Agentscited by 0
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026OpenBioRQ: Unsolved Biomedical Research Questions for Agents20 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification
- 2026CrowdMath: A Dataset of Crowdsourced Mathematical Research Discussions
- 2026RMA: an Agentic System for Research-Level Mathematical Problems
- 2026Iteris: Agentic Research Loops for Computational Mathematics
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier
- 2024ControlMath: Controllable Data Generation Promotes Math Generalist Models
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval
- 2025IMProofBench: Benchmarking AI on Research-Level Mathematical Proof Generation