mlsanityData to 7 Oct 2026

AlphaResearch: Accelerating New Algorithm Discovery with Language Models

arXiv 2511.08522 ↗First posted 11 Nov 2025cs.CLcited by 9

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

LLMs have made significant progress in complex but easy-to-verify problems, yet they still struggle with discovering the unknown. In this paper, we present AlphaResearch, an autonomous research agent designed to discover new algorithms on open-ended problems by iteratively running the following steps: (1) propose new ideas (2) program to verify (3) optimize the research proposals. To synergize the feasibility and innovation of the discovery process, we construct a novel dual environment by combining the execution-based verifiable reward and reward from simulated real-world peer review environment in AlphaResearch. We construct dataset, a set of questions that includes an eight open-ended algorithmic problems competition to benchmark AlphaResearch. Experimental results show that AlphaResearch achieves stronger discovery performance than other agentic discovery systems on six open-ended problems. Notably, the algorithm discovered by AlphaResearch on the ``packing circles'' problem achieves the best-of-known performance, surpassing the results of human researchers and strong baselines from recent work (e.g., AlphaEvolve). Additionally, we conduct a comprehensive analysis of the benefits and remaining challenges of autonomous research agent, providing valuable insights for future research.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 37 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

29 of 37 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering9 Oct
  2. 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents26 Aug
  3. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct

Other references · 26

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  9. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  10. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  11. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
14 more
  1. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  2. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  3. 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
  4. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
  5. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
  6. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
  7. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
  8. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
  9. 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
  10. 2024Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Taskscited by 102
  11. 2025An AI system to help scientists write expert-level empirical softwarecited by 52
  12. 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 49
  13. 2023WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuningcited by 42
  14. 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery
  2. 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
  3. 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery
  4. 2026AutoScientist-Quant: Self-Evolving Coding Agents for Automatic Research in Quantitative Investment
  5. 2026EPOCH: Reliable Discovery through Evidence-Governed Search
  6. 2026AgentDiscover: Autonomous Discovery with Minimal Search Scaffolding
  7. 2026From AI Assistant to AI Scientist: Autonomous Discovery of LLM-RL Algorithms with LLM Agents
  8. 2025Mathematical exploration and discovery at scale