mlsanityData to 14 Oct 2026

Artifact-centered Claim-aware Observability for Autonomous Scientific Agents

arXiv 2608.18312 ↗First posted 18 Aug 2026cs.CL cs.CY cs.HCcited by 3

Not on the map. Why?

Abstract (arXiv)

Autonomous scientific agents now increasingly propose ideas, write code, run experiments, analyze results, and even draft papers. Observe and audit those agents are necessary but logging every model call is not enough, scientists also need to inspect the artifacts and claims that the systems produced and their relations. This is driven by the fact that failures in scientific agent systems are often distributed across several objects. A manuscript claim may cite the wrong evidence, a search process may select a degenerate candidate, a laboratory novelty claim may depend on an unstated rule, or a multi-agent plan may change without a visible trigger. Existing tracing, experiment tracking, and archival provenance tools are valuable, but their native objects do not make these scientific audit relations first-class. We argue that autonomous scientific systems should emit portable, claim-aware artifact lineage as a minimum audit layer. We propose a compact observability profile organized around individuals, operators, fitness records, lineage, archives, runs, streams, and steering commands. In this profile, scientific claims are ordinary individuals with explicit evidence bindings and verification records. The profile is intended as a semantic layer that complements current telemetry and provenance standards. Execution details can remain in OpenTelemetry. Final packages can export to PROV-O or RO-Crate standards.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

9 of 23 references.

References · 9

  1. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  2. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  3. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  4. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  5. 2026Towards End-to-End Automation of AI Researchcited by 159
  6. 2025Evaluating Sakana's AI Scientist: Bold Claims, Mixed Results, and a Promising Future?cited by 32
  7. 2021Packaging research artefacts with RO-Cratecited by 24
  8. 2026The Last Human-Written Paper: Agent-Native Research Artifactscited by 16
  9. 2026GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language Modelscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.