mlsanityData to 14 Oct 2026

Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents

arXiv 2607.09195 ↗First posted 10 Jul 2026cs.AI cond-mat.mtrl-scicited by 3

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Large language model (LLM) agents are increasingly expected to play a central role in AI-driven scientific discovery. Equipped with broad knowledge, flexible reasoning, and tool use, they have the potential to autonomously explore and solve scientific problems by repeatedly proposing hypotheses, testing them, and revising their beliefs in the light of the evidence. In current agents, however, these hypotheses, tests, and belief updates are buried in unstructured logs, and no mechanism lets the agent or the human researcher audit that process. Here we propose the Hypothesis Evolution Protocol (HEP), an agent harness that provides hypothesis generation, evaluation, and evolution as explicit, auditable operations. On materials-science research tasks, a HEP-equipped agent operates the hypothesis--test--evidence--belief cycle that planning-style agents lack, generalizes across research questions, and exploits the protocol more fully as the base LLM becomes more capable. These results mark a step toward auditable AI scientists, whose scientific reasoning can be inspected, verified, and built upon.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 45 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

34 of 45 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Agentic AI Scientists Are Not Built For Autonomous Scientific Discovery9 May
  2. 2025Automated Hypothesis Validation with Agentic Sequential Falsifications14 Feb

Other references · 32

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  5. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  6. 2025Accelerating scientific discovery with Co-Scientistcited by 401
  7. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
  8. 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 196
  9. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
  10. 2026Towards End-to-End Automation of AI Researchcited by 159
  11. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 130
  12. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
20 more
  1. 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
  2. 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
  3. 2025Robin: A multi-agent system for automating scientific discoverycited by 62
  4. 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 61
  5. 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 44
  6. 2024LLMatDesign: Autonomous Materials Discovery with Large Language Modelscited by 42
  7. 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
  8. 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
  9. 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 18
  10. 2026AI scientists produce results without reasoning scientificallycited by 17
  11. 2025ChemGraph: An Agentic Framework for Computational Chemistry Workflowscited by 16
  12. 2025MOOSE-Chem2: Exploring LLM Limits in Fine-Grained Scientific Hypothesis Discovery via Hierarchical Searchcited by 15
  13. 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchangecited by 11
  14. 2026DiscoverPhysics: Benchmarking LLMs for Out-of-the-Box Scientific Thinkingcited by 10
  15. 2026Agentic LLM Reasoning in a Self-Driving Laboratory for Air-Sensitive Lithium Halide Spinel Conductorscited by 6
  16. 2026Harnessing AtomisticSkills for Agentic Atomistic Researchcited by 6
  17. 2025BioDisco: Multi-agent hypothesis generation with dual-mode evidence, iterative feedback and temporal evaluationcited by 5
  18. 2026Performance of AI agents based on reasoning language models on ALD process optimization taskscited by 3
  19. 2026Towards Agentic Intelligence for Materials Sciencecited by 3
  20. 2026Workflow Closure Is Not Scientific Closure in Auto-Research Systemscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents
  2. 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics
  3. 2026FirstResearch: Auditable Question Formation for LLM Scientific Discovery Agents
  4. 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery
  5. 2026Triage-PiEvo: Evidence Admission for Principle-Evolving Scientific Agents
  6. 2026Beyond Execution: Auditing Experimental Fidelity in LLM-Driven Scientific Research
  7. 2026FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights
  8. 2026EvoMaster: A Foundational Evolving Agent Framework for Agentic Science at Scale