Evidence-Ledger Adjudication for Claim-Evidence Traceability
Not on the map. Why?
Abstract (arXiv)
AI agents can draft claims faster than authors can check whether the cited or retrieved evidence supports them. We study evidence-ledger adjudication: a claim-evidence traceability workflow that pairs each claim with an evidence packet, assigns a support relation, and routes unsupported, contradicted, or mixed-evidence claims back to the author. The empirical core is a 2,335-row blind benchmark built from independent external labels in AVeriTeC, CLIMATE-FEVER, and SciFact. Gold relations and source evidence labels are hidden during prediction and joined only for scoring. On this benchmark, the agent evidence-ledger condition achieves 0.676 relation accuracy and 0.601 macro-F1, compared with 0.383 accuracy and 0.303 macro-F1 for the best non-agent baseline. It also routes 1270/1435 claims whose gold labels indicate contradiction, missing evidence, or mixed evidence, while routing 295/900 supported claims. These results show that evidence-ledger adjudication can turn heterogeneous evidence packets into an auditable traceability layer for AI-assisted writing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 10 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
6 of 10 references.
References · 6
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoningcited by 4
Built on by
Not cited yet.