mlsanityData to 7 Oct 2026

The Age of AI Agents Demands A New Scientific Paradigm To Sustain Trustworthy Science

arXiv 2607.26064 ↗First posted 18 Jun 2026cs.CY cs.AIcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

AI systems are becoming autonomous research agents that generate hypotheses, design experiments, and produce discoveries at scales beyond human oversight. As seen by increased submissions to ML venues, the verification gap between scientific output and our ability to check it is already widening, and autonomous agents make it worse by magnitudes given human-agent asymmetry. We argue that science must evolve its verification infrastructure, as it has before with peer review. However, while historical adaptations assumed human contributors who could be questioned and sanctioned, AI agents break this assumption. We propose criteria for an adapted verification infrastructure that emphasizes observable-by-default workflows, scalable verification, and clear attribution. We argue that without adaptation, ML and any scientific domain using agents face dangerous failures: experimental results that no person can verify, optimization for metrics over understanding, and accountability vacuums that erode scientific trust.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 38 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

17 of 38 references.

References · 17

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  6. 2018Datasheets for Datasetscited by 1,371
  7. 2018Model Cards for Model Reportingcited by 1,068
  8. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  9. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 505
  10. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
  11. 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 318
  12. 2023An Overview of Catastrophic AI Riskscited by 214
5 more
  1. 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 95
  2. 2021Demystifying the Draft EU Artificial Intelligence Actcited by 82
  3. 2025International AI Safety Reportcited by 64
  4. 2025The More You Automate, the Less You See: Hidden Pitfalls of AI Scientist Systemscited by 24
  5. 2024Rethinking Explainable Machine Learning as Applied Statisticscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AI Scientists as Engines of Discovery: A Case for Development within Reformed Institutions
  2. 2026Agentic AI Scientists Are Not Built For Autonomous Scientific Discovery
  3. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap
  4. 2025Bohrium + SciMaster: Building the Infrastructure and Ecosystem for Agentic Science at Scale
  5. 2026Beyond Natural Language: An Agent-Native Language for Autonomous Science
  6. 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems
  7. 2026Architecting Trust in Artificial Epistemic Agents
  8. 2026A Society of Researchers: Designing Institutions for Populations of Autonomous Research Agents