The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
AI tools and agents are reshaping how researchers work, from proving theorems to training neural networks. Yet for many, it remains unclear how these tools fit into everyday research practice. This paper is a practical guide to AI-assisted research in mathematics and machine learning: We discuss how researchers can use modern AI systems productively, where these systems help most, and what kinds of guardrails are needed to use them responsibly. It is organized into three parts: (I) a five-level taxonomy of AI integration, (II) an open-source framework that, through a set of methodological rules formulated as agent prompts, turns CLI coding agents (e.g., Claude Code, Codex CLI, OpenCode) into autonomous research assistants, and (III) case studies from deep learning and mathematics. The framework runs inside a sandboxed container, works with any frontier LLM through existing CLI agents, is simple enough to install and use within minutes, and scales from personal-laptop prototyping to multi-node, multi-GPU experimentation across compute clusters. In practice, our longest autonomous session ran for over 20 hours, dispatching independent experiments across multiple nodes without human intervention. We stress that our framework is not intended to replace the researcher in the loop, but to augment them. Our code is publicly available at https://github.com/ZIB-IOL/The-Agentic-Researcher.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 81 of its 118 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
81 of 118 references.
Closest ancestors · 3
Same direction, newest first
- 2025Mathematical exploration and discovery at scale3 Nov
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct
- 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graph6 Oct
Other references · 78
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
38 more
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
- 2022Autoformalization with Large Language Modelscited by 252
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2021Accelerating Sparse Deep Neural Networkscited by 213
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 95
- 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 86
- 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
- 2025NorMuon: Making Muon more efficient and scalablecited by 74
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
- 2025AdaMuon: Adaptive Muon Optimizercited by 59
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 58
- 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 54
- 2025Benchmarking Optimizers for Large Language Model Pretrainingcited by 53
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
- 2025ThetaEvolve: Test-time Learning on Open Problemscited by 52
- 2025Aristotle: IMO-level Automated Theorem Provingcited by 47
- 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
- 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suitecited by 45
- 2024MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Datacited by 43
- 2025Early science acceleration experiments with GPT-5cited by 35
- 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
- 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoningcited by 34
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematicscited by 30
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformerscited by 29
- 2025The Open Proof Corpus: A Large-Scale Study of LLM-Generated Mathematical Proofscited by 27
- 2026First Proofcited by 26
- 2026DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolutioncited by 23
- 2023Sparse Model Soups: A Recipe for Improved Pruning via Model Averagingcited by 20
- 2025Autoformalization in the Wild: Assessing LLMs on Real-World Mathematical Definitionscited by 20
- 2021You Are the Best Reviewer of Your Own Papers: An Owner-Assisted Scoring Mechanismcited by 18
50 most cited of 78 All 78 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 13
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 9
- 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 6
- 2026When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficultycited by 0
- 2026When Does LLM Orchestration Pay Off? A Controlled Evaluation of Accuracy, Cost, and Task Difficulty1 Aug 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problems20 May 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Iteris: Agentic Research Loops for Computational Mathematics
- 2024Mathematics and Machine Creativity: A Survey on Bridging Mathematics with AI
- 2025AI-Researcher: Autonomous Scientific Innovation
- 2026Towards Autonomous Mathematics Research
- 2026Bolzano: Case Studies in LLM-Assisted Mathematical Research
- 2026When Algorithmic Exploration Becomes Cheap: A Case Study of Agentic Research in EDA
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
- 2025AI Mathematician: Towards Fully Automated Frontier Mathematical Research