AlphaResearch: Accelerating New Algorithm Discovery with Language Models
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
LLMs have made significant progress in complex but easy-to-verify problems, yet they still struggle with discovering the unknown. In this paper, we present AlphaResearch, an autonomous research agent designed to discover new algorithms on open-ended problems by iteratively running the following steps: (1) propose new ideas (2) program to verify (3) optimize the research proposals. To synergize the feasibility and innovation of the discovery process, we construct a novel dual environment by combining the execution-based verifiable reward and reward from simulated real-world peer review environment in AlphaResearch. We construct dataset, a set of questions that includes an eight open-ended algorithmic problems competition to benchmark AlphaResearch. Experimental results show that AlphaResearch achieves stronger discovery performance than other agentic discovery systems on six open-ended problems. Notably, the algorithm discovered by AlphaResearch on the ``packing circles'' problem achieves the best-of-known performance, surpassing the results of human researchers and strong baselines from recent work (e.g., AlphaEvolve). Additionally, we conduct a comprehensive analysis of the benefits and remaining challenges of autonomous research agent, providing valuable insights for future research.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 37 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
29 of 37 references.
Closest ancestors · 3
Same direction, newest first
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering9 Oct
- 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents26 Aug
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct
Other references · 26
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
14 more
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
- 2024Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Taskscited by 102
- 2025An AI system to help scientists write expert-level empirical softwarecited by 52
- 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 49
- 2023WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuningcited by 42
- 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problemcited by 6
- 2026Effective Harness Engineering for Algorithm Discovery with Coding Agentscited by 4
- 2026Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discoverycited by 3
- 2026AutoTrainess: Teaching Language Models to Improve Language Models Autonomouslycited by 2
- 2026Can LLM design high-quality experiments? A Comprehensive and Systematic Benchmark on Autonomous Experimental Designcited by 1
- 2026AgentLTV: An Agent-Based Unified Search-and-Evolution Framework for Automated Lifetime Value Predictioncited by 0
- 2026Towards a new paradigm of scientific discovery with socialized artificial intelligencecited by 0
- 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systemscited by 0
- 2026BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstructioncited by 0
- 2026BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstruction21 Sep 2026
- 2026Can LLM design high-quality experiments? A Comprehensive and Systematic Benchmark on Autonomous Experimental Design4 Aug 2026
- 2026Towards a new paradigm of scientific discovery with socialized artificial intelligence3 Aug 2026
- 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems2 Aug 2026
- 2026AutoTrainess: Teaching Language Models to Improve Language Models Autonomously30 Jun 2026
- 2026Effective Harness Engineering for Algorithm Discovery with Coding Agents13 May 2026
- 2026Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discovery30 Mar 2026
- 2026AgentLTV: An Agent-Based Unified Search-and-Evolution Framework for Automated Lifetime Value Prediction25 Feb 2026
- 2026InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problem16 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery
- 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
- 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery
- 2026AutoScientist-Quant: Self-Evolving Coding Agents for Automatic Research in Quantitative Investment
- 2026EPOCH: Reliable Discovery through Evidence-Governed Search
- 2026AgentDiscover: Autonomous Discovery with Minimal Search Scaffolding
- 2026From AI Assistant to AI Scientist: Autonomous Discovery of LLM-RL Algorithms with LLM Agents
- 2025Mathematical exploration and discovery at scale