mlsanityData to 7 Oct 2026

Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap

arXiv 2607.12113 ↗First posted 13 Jul 2026cs.DC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

One year ago, the AISLE roadmap argued that autonomous laboratories operated as isolated islands and proposed a grassroots network organized around five critical dimensions. The field has since moved faster than anticipated. Multi-agent systems have produced experimentally validated hypotheses, self-driving laboratories have grown more interoperable and orchestrated, reasoning-trained and domain foundation models have raised the capability ceiling, and the Genesis Mission has placed autonomous experimentation at the center of U.S. federal science strategy, with industry emerging as a primary actor. Progress has met a sobering counter-current, including a corrected flagship discovery result, benchmarks showing that agents which rival experts on closed-ended questions still complete only a fraction of open-ended research, and fabricated citations surfacing at leading venues. We read this as the defining tension of the field. Producing a candidate discovery is no longer the hard part, but verifying it is, and this asymmetry now limits autonomous science more than raw model capability. We update the roadmap around seven dimensions, revisiting the original five and elevating two former cross-cutting concerns, trust, verification, and reproducibility, and safety, security, and governance, to first-class status. We assess the original milestones (M1 through M14) as achieved, partially achieved, reframed, or open, add four new milestones (M15 through M18), and scope the path forward to a two-year horizon. The first year concentrates on interfaces, protocol adoption, and the scaffolding of verification, and the second targets federation, zero-trust coordination, and governance. Throughout, we position the grassroots network as the interoperability fabric that lets national programs, international initiatives, and commercial platforms connect rather than re-silo.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 87 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

31 of 87 references.

References · 31

  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  2. 2019Green AIcited by 620
  3. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  4. 2023Cognitive Architectures for Language Agentscited by 422
  5. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
  6. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
  7. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
  8. 2019Explainable Machine Learning for Scientific Insights and Discoveriescited by 165
  9. 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmarkcited by 115
  10. 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 86
  11. 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
  12. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
19 more
  1. 2025Robin: A multi-agent system for automating scientific discoverycited by 57
  2. 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suitecited by 45
  3. 2025Measuring Agents in Productioncited by 35
  4. 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
  5. 2025Supporting Our AI Overlords: Redesigning Data Systems to be Agent-Firstcited by 30
  6. 2025PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflowscited by 29
  7. 2021Interpretable and Explainable Machine Learning for Materials Science and Chemistrycited by 26
  8. 2022Deep learning at the edge enables real-time streaming ptychographic imagingcited by 17
  9. 2025Empowering Scientific Workflows with Federated Agentscited by 16
  10. 2026Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025cited by 13
  11. 2025Academic journals' AI policies fail to curb the surge in AI-assisted academic writingcited by 12
  12. 2024Prioritizing High-Consequence Biological Capabilities in Evaluations of Artificial Intelligence Modelscited by 10
  13. 2026AgentSCOPE: Evaluating Contextual Privacy Across Agentic Workflowscited by 9
  14. 2025Experiences with Model Context Protocol Servers for Science and High Performance Computingcited by 6
  15. 2025A Grassroots Network and Community Roadmap for Interconnected Autonomous Science Laboratories for Accelerated Discoverycited by 4
  16. 2022Globus Automation Services: Research process automation across the space-time continuumcited by 3
  17. 2026Fantastic Scientific Agents and How to Build Them: AgentBuild for Rietveld Refinementcited by 3
  18. 2025Data Readiness for Scientific AI at Scalecited by 2
  19. 2024Accelerating Python Applications with Dask and ProxyStorecited by 1

Built on by

Not cited yet.