mlsanityData to 14 Oct 2026

Toward an Engineering of Science: Rebalancing Generation and Verification in the Age of AI

arXiv 2605.10425 ↗First posted 11 May 2026cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

AI systems can now cheaply generate plausible scientific artifacts such as papers, reviews, and surveys. This creates a risk of epistemic pollution in our scientific systems, where unreliable but plausible-looking artifacts can accumulate faster than the system can filter them out. The problem is structural: the epistemic infrastructure of science was calibrated to a world where producing a plausible artifact required substantial expertise, labor, and time, so generation cost itself served as a rough filter; AI weakens that filter without comparably lowering verification cost. We argue that AI-era science should treat this as an engineering problem: redesigning epistemic infrastructure to rebalance the costs of generation and verification. The current paper-centered system makes verification expensive: papers compress long-context scientific logic into prose, forcing reviewers, human or AI, to reconstruct underlying argument structure before they can evaluate it. As one step in this direction, we propose blueprints as preliminary epistemic infrastructure: structured, decomposed research artifacts that represent claims, evidence, assumptions, and definitions as typed graph components. Blueprints are designed to trade an upfront generation cost for cheaper, more local, more distributed verification downstream. We have instantiated the proposal in a proof-of-concept prototype.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 43 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

21 of 43 references.

References · 21

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  2. 2020Fact or Fiction: Verifying Scientific Claimscited by 554
  3. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
  4. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  5. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
  6. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
  7. 2025AI-Researcher: Autonomous Scientific Innovationcited by 100
  8. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  9. 2025Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewardscited by 34
  10. 2026Scientific production in the era of Large Language Modelscited by 32
  11. 2025When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Researchcited by 26
  12. 2025REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?cited by 21
9 more
  1. 2026HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferencescited by 19
  2. 2026The Last Human-Written Paper: Agent-Native Research Artifactscited by 16
  3. 2025Academic journals' AI policies fail to curb the surge in AI-assisted academic writingcited by 12
  4. 2025Position: The ML Community Must Build an AI-Augmented Peer-Review Ecosystemcited by 9
  5. 2025Stop DDoS Attacking the Research Community with AI-Generated Survey Paperscited by 7
  6. 2013Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communicationscited by 6
  7. 2026The Story is Not the Science: Execution-Grounded Evaluation of Mechanistic Interpretability Researchcited by 6
  8. 2022Nanopublication-Based Semantic Publishing and Reviewing: A Field Study with Formalization Paperscited by 2
  9. 2025An Intelligent Infrastructure as a Foundation for Modern Sciencecited by 1

Built on by

Not cited yet.