Toward Generalist Autonomous Research via Hypothesis-Tree Refinement
Not on the map. Why?
Abstract (arXiv)
Scientific progress depends on a repeated loop of exploration, experimentation, and abstraction. Researchers test candidate directions, interpret the evidence, and carry the resulting lessons into later attempts. We study how an AI agent can run this loop autonomously over long horizons. We introduce Arbor, a general framework for autonomous research that combines a long-lived coordinator, short-lived executors, and Hypothesis Tree Refinement (HTR), a persistent tree that links hypotheses, artifacts, evidence, and distilled insights across time. The coordinator manages global research strategy over the tree, while executors implement and test individual hypotheses in isolated worktrees. As results return, Arbor updates the tree, propagates reusable lessons, refines the search frontier, and admits verified improvements. This design turns autonomous research from a sequence of local attempts into a cumulative process in which strategy, execution, and evidence are carried across time. We evaluate Arbor under Autonomous Optimization (AO), an operational setting where an agent improves an initial research artifact through iterative experimentation without step-level human supervision. Across six real research tasks in model training, harness engineering, and data synthesis, Arbor achieves the best held-out result on all six tasks, attaining more than 2.5x the average relative held-out gain of Codex and Claude Code under the same task interface and resource budget. On MLE-Bench Lite, Arbor reaches 86.36% Any Medal with GPT-5.5, the strongest result in our comparison.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 50 of its 59 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
50 of 59 references.
References · 50
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
38 more
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2025Memory in the Age of AI Agentscited by 303
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 175
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
- 2025A Comprehensive Survey on Long Context Language Modelingcited by 117
- 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
- 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-benchcited by 71
- 2025The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMscited by 64
- 2026PostTrainBench: Can LLM Agents Automate LLM Post-Training?cited by 64
- 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 61
- 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 47
- 2026FrontierScience: Evaluating AI's Ability to Perform Expert-Level Scientific Taskscited by 47
- 2025MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineeringcited by 41
- 2026Toward Ultra-Long-Horizon Agentic Science: Cognitive Accumulation for Machine Learning Engineeringcited by 28
- 2025AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?cited by 27
- 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discoverycited by 27
- 2026MARS: Modular Agent with Reflective Search for Automated AI Researchcited by 25
- 2025HCAST: Human-Calibrated Autonomy Software Taskscited by 24
- 2025LoongFlow: Directed Evolutionary Search via a Cognitive Plan-Execute-Summarize Paradigmcited by 22
- 2025The FM Agentcited by 21
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 17
- 2026Frontier-Eng: Benchmarking Self-Evolving Agents on Real-World Engineering Tasks with Generative Optimizationcited by 16
- 2025The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvementscited by 15
- 2026AIBuildAI: An AI Agent for Automatically Building AI Modelscited by 13
- 2025A Survey of AI Scientistscited by 11
- 2026KAPSO: A Knowledge-grounded framework for Autonomous Program Synthesis and Optimizationcited by 11
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agentcited by 10
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvementcited by 11
- 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineeringcited by 8
- 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyondcited by 4
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
- 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 2
- 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
- 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Taskscited by 1
- 2026ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchscited by 1
- 2026AIM: Agentic Idea Management for Automated Researchcited by 1
- 2026Mathematical Discovery in the Wild: AI-Guided Proofs in Banach Space Theorycited by 0
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agentscited by 0
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideationcited by 0
10 more
- 2026EvoCast: Reliable Autonomous Research Agents for Iterative Forecasting Architecture Evolutioncited by 0
- 2026MMPostTrainBench: Benchmarking Autonomous Research for Multimodal Post-Trainingcited by 0
- 2026When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimationcited by 0
- 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agentscited by 0
- 2026JANUS: Enhancing Long-Horizon Autonomous Research with Co-Evolving World Modelscited by 0
- 2026AgentSWE: Can Coding Agents Build the Agent You Actually Want?cited by 0
- 2026SHELDON: Reasoning through Dual Search over Hypothesis and Observation Spacescited by 0
- 2026Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agentscited by 0
- 2026AReaL-RSI: Adaptive Scaling and Coordination of Recursive Self-Improvementcited by 0
- 2026SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarmcited by 0
- 2026SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarm14 Oct 2026
- 2026AReaL-RSI: Adaptive Scaling and Coordination of Recursive Self-Improvement13 Oct 2026
- 2026Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agents13 Oct 2026
- 2026SHELDON: Reasoning through Dual Search over Hypothesis and Observation Spaces13 Oct 2026
- 2026AgentSWE: Can Coding Agents Build the Agent You Actually Want?9 Oct 2026
- 2026JANUS: Enhancing Long-Horizon Autonomous Research with Co-Evolving World Models9 Oct 2026
- 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agents8 Oct 2026
- 2026When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation8 Oct 2026
- 2026MMPostTrainBench: Benchmarking Autonomous Research for Multimodal Post-Training4 Oct 2026
- 2026EvoCast: Reliable Autonomous Research Agents for Iterative Forecasting Architecture Evolution3 Oct 2026
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation2 Oct 2026
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents1 Oct 2026
10 more
- 2026AIM: Agentic Idea Management for Automated Research29 Sep 2026
- 2026AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement20 Aug 2026
- 2026What is Missing from AI Post-Training AI: An Empirical Analysis19 Aug 2026
- 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyond14 Aug 2026
- 2026ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchs13 Aug 2026
- 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Tasks5 Aug 2026
- 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering30 Jul 2026
- 2026Mathematical Discovery in the Wild: AI-Guided Proofs in Banach Space Theory19 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Development12 Jul 2026
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents10 Jul 2026
- 2026AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvementcited by 11
- 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyondcited by 4
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
- 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Taskscited by 1
- 2026AIM: Agentic Idea Management for Automated Researchcited by 1
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agentscited by 0
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideationcited by 0
- 2026EvoCast: Reliable Autonomous Research Agents for Iterative Forecasting Architecture Evolutioncited by 0
- 2026AgentSWE: Can Coding Agents Build the Agent You Actually Want?cited by 0
- 2026AgentSWE: Can Coding Agents Build the Agent You Actually Want?9 Oct 2026
- 2026EvoCast: Reliable Autonomous Research Agents for Iterative Forecasting Architecture Evolution3 Oct 2026
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation2 Oct 2026
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents1 Oct 2026
- 2026AIM: Agentic Idea Management for Automated Research29 Sep 2026
- 2026AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement20 Aug 2026
- 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyond14 Aug 2026
- 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Tasks5 Aug 2026
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents10 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 2
- 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
- 2026ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchscited by 1
- 2026Mathematical Discovery in the Wild: AI-Guided Proofs in Banach Space Theorycited by 0
- 2026MMPostTrainBench: Benchmarking Autonomous Research for Multimodal Post-Trainingcited by 0
- 2026SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarmcited by 0
- 2026SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarm14 Oct 2026
- 2026MMPostTrainBench: Benchmarking Autonomous Research for Multimodal Post-Training4 Oct 2026
- 2026What is Missing from AI Post-Training AI: An Empirical Analysis19 Aug 2026
- 2026ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchs13 Aug 2026
- 2026Mathematical Discovery in the Wild: AI-Guided Proofs in Banach Space Theory19 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Development12 Jul 2026