mlsanityData to 7 Oct 2026

The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning

arXiv 2603.15914 ↗First posted 16 Mar 2026cs.LG cs.AIcited by 4

On the map: LLM agents and tool use → Educational agents and math problem solving

Abstract (arXiv)

AI tools and agents are reshaping how researchers work, from proving theorems to training neural networks. Yet for many, it remains unclear how these tools fit into everyday research practice. This paper is a practical guide to AI-assisted research in mathematics and machine learning: We discuss how researchers can use modern AI systems productively, where these systems help most, and what kinds of guardrails are needed to use them responsibly. It is organized into three parts: (I) a five-level taxonomy of AI integration, (II) an open-source framework that, through a set of methodological rules formulated as agent prompts, turns CLI coding agents (e.g., Claude Code, Codex CLI, OpenCode) into autonomous research assistants, and (III) case studies from deep learning and mathematics. The framework runs inside a sandboxed container, works with any frontier LLM through existing CLI agents, is simple enough to install and use within minutes, and scales from personal-laptop prototyping to multi-node, multi-GPU experimentation across compute clusters. In practice, our longest autonomous session ran for over 20 hours, dispatching independent experiments across multiple nodes without human intervention. We stress that our framework is not intended to replace the researcher in the loop, but to augment them. Our code is publicly available at https://github.com/ZIB-IOL/The-Agentic-Researcher.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 81 of its 118 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

81 of 118 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Mathematical exploration and discovery at scale3 Nov
  2. 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct
  3. 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graph6 Oct

Other references · 78

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2016Pointer Sentinel Mixture Modelscited by 2,992
  3. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  4. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  5. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
  6. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  7. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
  8. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  9. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  10. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  11. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  12. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
38 more
  1. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
  2. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
  3. 2022Autoformalization with Large Language Modelscited by 252
  4. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
  5. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  6. 2021Accelerating Sparse Deep Neural Networkscited by 213
  7. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
  8. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
  9. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
  10. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
  11. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
  12. 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
  13. 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 95
  14. 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 86
  15. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
  16. 2025NorMuon: Making Muon more efficient and scalablecited by 74
  17. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
  18. 2025AdaMuon: Adaptive Muon Optimizercited by 59
  19. 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 58
  20. 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 54
  21. 2025Benchmarking Optimizers for Large Language Model Pretrainingcited by 53
  22. 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
  23. 2025ThetaEvolve: Test-time Learning on Open Problemscited by 52
  24. 2025Aristotle: IMO-level Automated Theorem Provingcited by 47
  25. 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
  26. 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suitecited by 45
  27. 2024MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Datacited by 43
  28. 2025Early science acceleration experiments with GPT-5cited by 35
  29. 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
  30. 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoningcited by 34
  31. 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematicscited by 30
  32. 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformerscited by 29
  33. 2025The Open Proof Corpus: A Large-Scale Study of LLM-Generated Mathematical Proofscited by 27
  34. 2026First Proofcited by 26
  35. 2026DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolutioncited by 23
  36. 2023Sparse Model Soups: A Recipe for Improved Pruning via Model Averagingcited by 20
  37. 2025Autoformalization in the Wild: Assessing LLMs on Real-World Mathematical Definitionscited by 20
  38. 2021You Are the Best Reviewer of Your Own Papers: An Owner-Assisted Scoring Mechanismcited by 18

50 most cited of 78 All 78 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Iteris: Agentic Research Loops for Computational Mathematics
  2. 2024Mathematics and Machine Creativity: A Survey on Bridging Mathematics with AI
  3. 2025AI-Researcher: Autonomous Scientific Innovation
  4. 2026Towards Autonomous Mathematics Research
  5. 2026Bolzano: Case Studies in LLM-Assisted Mathematical Research
  6. 2026When Algorithmic Exploration Becomes Cheap: A Case Study of Agentic Research in EDA
  7. 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
  8. 2025AI Mathematician: Towards Fully Automated Frontier Mathematical Research