The Warrant Gap: Claim-Conditioned Re-scoring for Fact-Checking
Not on the map. Why?
Abstract (arXiv)
Fact-checking systems built on LLMs achieve high verdict accuracy on standard benchmarks, yet routinely output Supports labels whose cited evidence does not license the claim. Structured decomposition is the natural way to inspect those warrants, but rigid extraction protocols strip the full-claim context that facets need. We introduce SIFT -- claim-conditioned re-scoring of extracted evidence spans against the full claim -- paired with WSP (Warranted Supports Proportion), an automatic NLI check that the cited warrant entails the claim. We evaluate on FEVER, SciFact, 5PILS, and DP across four open-source backbones. SIFT recovers accuracy on cells where naive decomposition costs up to 27.6 points, while raising WSP above direct prompting; WSP itself calibrates against human gold evidence at AUC 0.92 and precision 0.98.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
20 of 36 references.
References · 20
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 120
- 2021Decontextualization: Making Sentences Stand-Alonecited by 102
- 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
- 2024Molecular Facts: Desiderata for Decontextualization in LLM Fact Verificationcited by 44
8 more
- 2024Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance?cited by 36
- 2024DnDScore: Decontextualization and Decomposition for Factuality Verification in Long-Form Text Generationcited by 22
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
- 2025COVE: COntext and VEracity prediction for out-of-context imagescited by 14
- 2025Verifying the Verifiers: Unveiling Pitfalls and Potentials in Fact Verifierscited by 13
- 2025Optimizing Decomposition for Optimal Claim Verificationcited by 10
- 2025The Missing Parts: Augmenting Fact Verification with Half-Truth Detectioncited by 7
- 2025Extractive Fact Decomposition for Interpretable Natural Language Inference in one Forward Passcited by 3
Built on by
Not cited yet.