From Fluent to Verifiable: Claim-Level Auditability for Deep Research Agents
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
A deep research agent produces a fluent scientific report in minutes; a careful reader then tries to verify the main claims and discovers the real cost is not reading, but tracing: which sentence is supported by which passage, what was ignored, and where evidence conflicts. We argue that as research generation becomes cheap, auditability becomes the bottleneck, and the dominant risk shifts from isolated factual errors to scientifically styled outputs whose claim-evidence links are weak, missing, or misleading. This perspective proposes claim-level auditability as a first-class design and evaluation target for deep research agents, distills recurring long-horizon failure modes (objective drift, transient constraints, and unverifiable inference), and introduces the Auditable Autonomous Research (AAR) standard, a compact measurement framework that makes auditability testable via provenance coverage, provenance soundness, contradiction transparency, and audit effort. We then argue for semantic provenance with protocolized validation: persistent, queryable provenance graphs that encode claim--evidence relations (including conflicts) and integrate continuous validation during synthesis rather than after publication, with practical instrumentation patterns to support deployment at scale.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 27 of its 66 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
27 of 66 references.
Closest ancestors · 4
Same direction, newest first
- 2026RE-TRAC: REcursive TRAjectory Compression for Deep Search Agents2 Feb
- 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents10 Nov
- 2025DeepTRACE: Auditing Deep Research AI Systems for Tracking Reliability Across Citations and Evidence2 Sep
- 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Tasks14 Aug
Other references · 23
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 136
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2024A Note on Shumailov et al. (2024): `AI Models Collapse When Trained on Recursively Generated Data'cited by 114
- 2025Evaluating Sakana's AI Scientist: Bold Claims, Mixed Results, and a Promising Future?cited by 32
- 2025AI Scientists Fail Without Strong Implementation Capabilitycited by 20
- 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
11 more
- 2025AgentGuard: Runtime Verification of AI Agentscited by 16
- 2025VeriLA: A Human-Centered Evaluation Framework for Interpretable Verification of LLM Agent Failurescited by 14
- 2025A Benchmark for Evaluating Outcome-Driven Constraint Violations in Autonomous AI Agentscited by 12
- 2025Do Cognitively Interpretable Reasoning Traces Improve LLM Performance?cited by 11
- 2024Evaluation-Driven Development and Operations of LLM Agents: A Process Model and Reference Architecturecited by 10
- 2024Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoningcited by 9
- 2025Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agentscited by 9
- 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
- 2025Hell or High Water: Evaluating Agentic Recovery from External Failurescited by 6
- 2024Assessing the Auditability of AI-integrating Systems: A Framework and Learning Analytics Case Studycited by 3
- 2025VeriTrail: Closed-Domain Hallucination Detection with Traceabilitycited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 25
- 2026The Last Human-Written Paper: Agent-Native Research Artifactscited by 12
- 2026Agon: An Autonomous Large-Scale Omnidisciplinary Research System Built on Prompt Economycited by 4
- 2026StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discoverycited by 1
- 2026Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generationcited by 1
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026Making AI-Assisted Claims Independently Challengeable: Publication Authority and a Protocol for Falsifiable Publication Recordscited by 0
- 2026Making AI-Assisted Claims Independently Challengeable: Publication Authority and a Protocol for Falsifiable Publication Records15 Sep 2026
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation3 Aug 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
- 2026Agon: An Autonomous Large-Scale Omnidisciplinary Research System Built on Prompt Economy23 Jun 2026
- 2026StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discovery10 Jun 2026
- 2026The Last Human-Written Paper: Agent-Native Research Artifacts27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality
- 2026Beyond the Text: Verifying That Agent-Written Papers Are Backed by Their Artifacts
- 2026DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning
- 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Tasks
- 2026Beyond Execution: Auditing Experimental Fidelity in LLM-Driven Scientific Research
- 2026YouRA: A Persistent-State Architecture for Evidence-Traceable Autonomous Research Agents
- 2026From Trajectories to Evidence: Auditable Experimental Records for Industrial Research Agents