mlsanityData to 14 Oct 2026

Evidence-Ledger Adjudication for Claim-Evidence Traceability

arXiv 2607.26512 ↗First posted 29 Jul 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

AI agents can draft claims faster than authors can check whether the cited or retrieved evidence supports them. We study evidence-ledger adjudication: a claim-evidence traceability workflow that pairs each claim with an evidence packet, assigns a support relation, and routes unsupported, contradicted, or mixed-evidence claims back to the author. The empirical core is a 2,335-row blind benchmark built from independent external labels in AVeriTeC, CLIMATE-FEVER, and SciFact. Gold relations and source evidence labels are hidden during prediction and joined only for scoring. On this benchmark, the agent evidence-ledger condition achieves 0.676 relation accuracy and 0.601 macro-F1, compared with 0.383 accuracy and 0.303 macro-F1 for the best non-agent baseline. It also routes 1270/1435 claims whose gold labels indicate contradiction, missing evidence, or mixed evidence, while routing 295/900 supported claims. These results show that evidence-ledger adjudication can turn heterogeneous evidence packets into an auditable traceability layer for AI-assisted writing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 10 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

6 of 10 references.

References · 6

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  2. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  3. 2020Fact or Fiction: Verifying Scientific Claimscited by 554
  4. 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
  5. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  6. 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoningcited by 4

Built on by

Not cited yet.