mlsanityData to 14 Oct 2026

More Claims, Less Evidence: Bounded Verification of AI-Generated Digital Knowledge Artifacts

arXiv 2610.05547 ↗First posted 4 Oct 2026cs.AI cs.DLcited by 0

Not on the map. Why?

Abstract (arXiv)

Digital libraries, repositories, and AI-mediated knowledge services increasingly rely on generative systems to produce summaries, descriptions, and other multi-claim knowledge objects. Yet generation can scale far more easily than verification capacity: a reviewer may need to decide whether an object is suitable for publication or downstream use after checking only a small fraction of its claims. This creates a fundamental gap between claim-level verification and confidence in the object as a whole. The central question is therefore what a successful partial check implies about the reliability of the complete artifact when its size grows but the verification budget does not. This paper contributes a Bayesian model of bounded verification centered on the Predictive Value of Pass (PVP). The model predicts that evidentiary value decreases as artifacts grow under fixed verification capacity, improves with larger verification budgets, and is especially fragile when errors are sparse. Controlled experiments on FEVEROUS and FEVER support these predictions and show that adding supported claims around a fixed number of false or unsupported claims can make passing more likely while making a pass less informative. The model further yields the minimum verification budget required to maintain a target PVP, providing a practical component for AI-assisted quality-assurance workflows in which generated knowledge objects must be checked before publication or downstream use.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

17 of 26 references.

References · 17

  1. 2018Datasheets for Datasetscited by 1,386
  2. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  3. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  4. 2018Model Cards for Model Reportingcited by 1,080
  5. 2020Fact or Fiction: Verifying Scientific Claimscited by 554
  6. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  7. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 225
  8. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
  9. 2024Long-form factuality in large language modelscited by 155
  10. 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 117
  11. 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 86
  12. 2025On Verifiable Legal Reasoning: A Multi-Agent Framework with Formalized Knowledge Representationscited by 18
5 more
  1. 2025FaStfact: Faster, Stronger Long-Form Factuality Evaluations in LLMscited by 8
  2. 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Modelscited by 2
  3. 2026Generative Agents Navigating Digital Librariescited by 1
  4. 2026Toward Explanatory Equilibrium: Verifiable Reasoning as a Coordination Mechanism under Asymmetric Informationcited by 1
  5. 2026MultiHedge: Adaptive Coordination via Retrieval-Augmented Controlcited by 1

Built on by

Not cited yet.