mlsanityData to 7 Oct 2026

The Half-Lives of Generative-AI Evidence: A 40-Record Audit, a Claim-Currency Framework, and a Reflexive Case of Frontier-Model-Assisted Research

arXiv 2607.24032 ↗First posted 27 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative-AI evaluations can become historical before publication, yet calendar age does not affect every conclusion equally. This paper has two linked purposes. First, it audits a maximum-variation purposive corpus of 40 empirical records appearing between 18 July 2025 and 17 July 2026. The audit coded publication route, execution timing, model identity, age of the newest named generation or immutable snapshot, same-family supersession and refresh behaviour. At appearance, the newest named model was a median 281 days old (middle 50%: 75-478; range: 11-939). Median age was 395 days for 25 journal articles, 56 days for 14 preprints and 49 days for one laboratory report. Thirty-five records included a superseded family, seven supplied a precise dated identifier, three clearly refreshed model evidence, and one added a late sensitivity test. All 40 included an OpenAI system, a feature of this corpus rather than a prevalence estimate. The paper distinguishes model age from claim currency and proposes six reporting practices. Second, it treats its own two-day production process as a reflexive case of frontier-model-assisted research creation. GPT-5.6 Sol Pro in ChatGPT supported candidate discovery, source reconciliation, calculations, drafting and critique; the author checked sources, made all substantive decisions and accepts responsibility. This is a proof-of-practice, not a controlled estimate of productivity or quality. By applying its own Model Facts and model-currency statement, the paper shows how rapid AI-assisted research can be made inspectable without treating model output as independent validation. The title uses half-lives metaphorically; no universal decay rate is estimated.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 18 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

6 of 18 references.

References · 6

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  2. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 224
  3. 2025Early science acceleration experiments with GPT-5cited by 35
  4. 2025Chasing Shadows: Pitfalls in LLM Security Researchcited by 10
  5. 2025Large Language Models for Software Engineering: A Reproducibility Crisiscited by 8
  6. 2026Frontier Lag: A Bibliometric Audit of Capability Misrepresentation in Academic AI Evaluationcited by 2

Built on by

Not cited yet.