One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Autonomous research agents can now draft hypotheses, write code, run experiments, and produce papers, but they remain brittle when experiments fail. Under the prevailing paradigm, failure recovery is usually delegated to a single free-form reflection: a rich trajectory of metrics, logs, and design choices is compressed into one verbal critique, which often leads either to localized trial-and-error or to hard pivots that discard useful context. We propose SAGE, a Self-correcting, Autonomous, Grounded Experimenter, to tackle this failure-recovery bottleneck. Its core mechanism, Multi-Hypothesis Failure Attribution (MHFA), treats recovery as a structured causal diagnosis. By analyzing dynamic trajectory features, MHFA systematically generates multiple evidence-grounded explanations for a failure, independently evaluates their severity, and deterministically routes the verified root cause to the correct intervention level (hypothesis, experimental design, or implementation). To guarantee scientific honesty, SAGE further employs a grounded reporting mechanism that explicitly constrains drafted results to actual measured values, redacting hallucinated numbers. On a 12-topic, 5-domain benchmark, SAGE increases metrics-bearing outputs from 42% to 92% over a reflection baseline, improves artifact quality from 5.00 to 6.75/10, and blindly outscores AI-Scientist-v2 (52.0 vs. 48.2), with gains concentrated in code development and execution. While fully autonomous scientific writing and generating conference-ready papers remain notoriously difficult open problems for the entire field, SAGE successfully produces significantly more reliable and higher-quality scientific artifacts. Ultimately, by coupling structured recovery with explicit grounding constraints, SAGE significantly outperforms monolithic reflection paradigms, establishing a highly trustworthy foundation for future autonomous research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 53 of its 69 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
53 of 69 references.
Closest ancestors · 15
Same direction, newest first
- 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration4 May
- 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery9 Mar
- 2026Why LLMs Aren't Scientists Yet: Lessons from Four Autonomous Research Attempts6 Jan
- 2025Deep Research: A Survey of Autonomous Research Agents18 Aug
- 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinement27 May
- 2025MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research26 May
- 2025AI-Researcher: Autonomous Scientific Innovation24 May
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering9 Oct
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery7 Oct
- 2024Language agents achieve superhuman synthesis of scientific knowledge10 Sep
3 more
Other references · 38
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2023Teaching Large Language Models to Self-Debugcited by 988
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
26 more
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2023Large Language Models as Optimizerscited by 864
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
- 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
- 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 154
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 132
- 2023Hypothesis Search: Inductive Reasoning with Language Modelscited by 120
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 63
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 61
- 2025The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agentscited by 45
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 37
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
- 2026AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaborationcited by 25
- 2026How Far Are We From True Auto-Research?cited by 10
- 2026Camyla: Scaling Autonomous Research in Medical Image Segmentationcited by 5
- 2026End-to-end autonomous scientific discovery on a real optical platformcited by 5
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systemscited by 5
- 2026Sibyl-AutoResearch: Autonomous Research Needs Self-Evolving Trial-and-Error Harnesses, Not Paper Generatorscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks
- 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence
- 2026EviGraph: Evidence-Guided Autonomous Research Agents
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference
- 2025Abduct, Act, Predict: Scaffolding Causal Inference for Automated Failure Attribution in Multi-Agent Systems
- 2026Diagnosis Before Recovery: Turning Agent Failures into Selective Self-Correction
- 2026From Experiments to Decisions: Reusing Evidence in Autonomous Coding Research
- 2026Beyond Execution: Auditing Experimental Fidelity in LLM-Driven Scientific Research