mlsanityData to 14 Oct 2026

Toward Generalist Autonomous Research via Hypothesis-Tree Refinement

arXiv 2606.11926 ↗First posted 10 Jun 2026cs.CL cs.AIcited by 22

Not on the map. Why?

Abstract (arXiv)

Scientific progress depends on a repeated loop of exploration, experimentation, and abstraction. Researchers test candidate directions, interpret the evidence, and carry the resulting lessons into later attempts. We study how an AI agent can run this loop autonomously over long horizons. We introduce Arbor, a general framework for autonomous research that combines a long-lived coordinator, short-lived executors, and Hypothesis Tree Refinement (HTR), a persistent tree that links hypotheses, artifacts, evidence, and distilled insights across time. The coordinator manages global research strategy over the tree, while executors implement and test individual hypotheses in isolated worktrees. As results return, Arbor updates the tree, propagates reusable lessons, refines the search frontier, and admits verified improvements. This design turns autonomous research from a sequence of local attempts into a cumulative process in which strategy, execution, and evidence are carried across time. We evaluate Arbor under Autonomous Optimization (AO), an operational setting where an agent improves an initial research artifact through iterative experimentation without step-level human supervision. Across six real research tasks in model training, harness engineering, and data synthesis, Arbor achieves the best held-out result on all six tasks, attaining more than 2.5x the average relative held-out gain of Codex and Claude Code under the same task interface and resource budget. On MLE-Bench Lite, Arbor reaches 86.36% Any Medal with GPT-5.5, the strongest result in our comparison.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 50 of its 59 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

50 of 59 references.

References · 50

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  7. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  8. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  9. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  10. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  11. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  12. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
38 more
  1. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
  2. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  3. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  4. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  5. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  6. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
  7. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  8. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
  9. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  10. 2025Memory in the Age of AI Agentscited by 303
  11. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
  12. 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
  13. 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 175
  14. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
  15. 2025A Comprehensive Survey on Long Context Language Modelingcited by 117
  16. 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
  17. 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-benchcited by 71
  18. 2025The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMscited by 64
  19. 2026PostTrainBench: Can LLM Agents Automate LLM Post-Training?cited by 64
  20. 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 61
  21. 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 47
  22. 2026FrontierScience: Evaluating AI's Ability to Perform Expert-Level Scientific Taskscited by 47
  23. 2025MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineeringcited by 41
  24. 2026Toward Ultra-Long-Horizon Agentic Science: Cognitive Accumulation for Machine Learning Engineeringcited by 28
  25. 2025AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?cited by 27
  26. 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discoverycited by 27
  27. 2026MARS: Modular Agent with Reflective Search for Automated AI Researchcited by 25
  28. 2025HCAST: Human-Calibrated Autonomy Software Taskscited by 24
  29. 2025LoongFlow: Directed Evolutionary Search via a Cognitive Plan-Execute-Summarize Paradigmcited by 22
  30. 2025The FM Agentcited by 21
  31. 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 17
  32. 2026Frontier-Eng: Benchmarking Self-Evolving Agents on Real-World Engineering Tasks with Generative Optimizationcited by 16
  33. 2025The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvementscited by 15
  34. 2026AIBuildAI: An AI Agent for Automatically Building AI Modelscited by 13
  35. 2025A Survey of AI Scientistscited by 11
  36. 2026KAPSO: A Knowledge-grounded framework for Autonomous Program Synthesis and Optimizationcited by 11
  37. 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agentcited by 10
  38. 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvementcited by 11
  2. 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineeringcited by 8
  3. 2026ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyondcited by 4
  4. 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
  5. 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 2
  6. 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
  7. 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Taskscited by 1
  8. 2026ARAC: Benchmarking Auto-Research's Alignment and Completeness on End-to-End Researchscited by 1
  9. 2026AIM: Agentic Idea Management for Automated Researchcited by 1
  10. 2026Mathematical Discovery in the Wild: AI-Guided Proofs in Banach Space Theorycited by 0
  11. 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agentscited by 0
  12. 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideationcited by 0
10 more
  1. 2026EvoCast: Reliable Autonomous Research Agents for Iterative Forecasting Architecture Evolutioncited by 0
  2. 2026MMPostTrainBench: Benchmarking Autonomous Research for Multimodal Post-Trainingcited by 0
  3. 2026When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimationcited by 0
  4. 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agentscited by 0
  5. 2026JANUS: Enhancing Long-Horizon Autonomous Research with Co-Evolving World Modelscited by 0
  6. 2026AgentSWE: Can Coding Agents Build the Agent You Actually Want?cited by 0
  7. 2026SHELDON: Reasoning through Dual Search over Hypothesis and Observation Spacescited by 0
  8. 2026Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agentscited by 0
  9. 2026AReaL-RSI: Adaptive Scaling and Coordination of Recursive Self-Improvementcited by 0
  10. 2026SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarmcited by 0