Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Large language model (LLM) agents are increasingly expected to play a central role in AI-driven scientific discovery. Equipped with broad knowledge, flexible reasoning, and tool use, they have the potential to autonomously explore and solve scientific problems by repeatedly proposing hypotheses, testing them, and revising their beliefs in the light of the evidence. In current agents, however, these hypotheses, tests, and belief updates are buried in unstructured logs, and no mechanism lets the agent or the human researcher audit that process. Here we propose the Hypothesis Evolution Protocol (HEP), an agent harness that provides hypothesis generation, evaluation, and evolution as explicit, auditable operations. On materials-science research tasks, a HEP-equipped agent operates the hypothesis--test--evidence--belief cycle that planning-style agents lack, generalizes across research questions, and exploits the protocol more fully as the base LLM becomes more capable. These results mark a step toward auditable AI scientists, whose scientific reasoning can be inspected, verified, and built upon.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 45 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
34 of 45 references.
Closest ancestors · 2
Same direction, newest first
- 2026Agentic AI Scientists Are Not Built For Autonomous Scientific Discovery9 May
- 2025Automated Hypothesis Validation with Agentic Sequential Falsifications14 Feb
Other references · 32
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 196
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2026Towards End-to-End Automation of AI Researchcited by 159
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 130
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
20 more
- 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
- 2025Robin: A multi-agent system for automating scientific discoverycited by 62
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 61
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 44
- 2024LLMatDesign: Autonomous Materials Discovery with Large Language Modelscited by 42
- 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
- 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 18
- 2026AI scientists produce results without reasoning scientificallycited by 17
- 2025ChemGraph: An Agentic Framework for Computational Chemistry Workflowscited by 16
- 2025MOOSE-Chem2: Exploring LLM Limits in Fine-Grained Scientific Hypothesis Discovery via Hierarchical Searchcited by 15
- 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchangecited by 11
- 2026DiscoverPhysics: Benchmarking LLMs for Out-of-the-Box Scientific Thinkingcited by 10
- 2026Agentic LLM Reasoning in a Self-Driving Laboratory for Air-Sensitive Lithium Halide Spinel Conductorscited by 6
- 2026Harnessing AtomisticSkills for Agentic Atomistic Researchcited by 6
- 2025BioDisco: Multi-agent hypothesis generation with dual-mode evidence, iterative feedback and temporal evaluationcited by 5
- 2026Performance of AI agents based on reasoning language models on ALD process optimization taskscited by 3
- 2026Towards Agentic Intelligence for Materials Sciencecited by 3
- 2026Workflow Closure Is Not Scientific Closure in Auto-Research Systemscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026EvoSCM: Scientific Belief Revision Through Causal Model Evolution and Experimentationcited by 2
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypothesescited by 2
- 2026Making AI-Assisted Claims Independently Challengeable: Publication Authority and a Protocol for Falsifiable Publication Recordscited by 0
- 2026Making AI-Assisted Claims Independently Challengeable: Publication Authority and a Protocol for Falsifiable Publication Records15 Sep 2026
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses14 Sep 2026
- 2026EvoSCM: Scientific Belief Revision Through Causal Model Evolution and Experimentation1 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics
- 2026FirstResearch: Auditable Question Formation for LLM Scientific Discovery Agents
- 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery
- 2026Triage-PiEvo: Evidence Admission for Principle-Evolving Scientific Agents
- 2026Beyond Execution: Auditing Experimental Fidelity in LLM-Driven Scientific Research
- 2026FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights
- 2026EvoMaster: A Foundational Evolving Agent Framework for Agentic Science at Scale