mlsanityData to 7 Oct 2026

From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence

arXiv 2605.06006 ↗First posted 7 May 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Fact-checking articles encode rich supporting evidence and reasoning, yet this evidence remains largely inaccessible to automated verification systems due to unstructured presentation. We introduce PrimeFacts, a methodology and resource for extracting fine-grained evidence from full fact-checking articles. We compile 13,106 PolitiFact articles with claims, verdicts, and all referenced sources, and we identify 49,718 in-article hyperlinks as natural anchors to pinpoint key evidence. Our framework leverages large language models (LLMs) to rewrite these anchor sentences into stand-alone, context-independent premises and investigates the extraction of additional implicit evidence. In evaluations on cross-article evidence retrieval and claim verification, the extracted premises substantially improve performance. Decontextualized evidence yields higher retrievability, achieving up to a 30 percent relative gain in Mean Reciprocal Rank over verbatim sentences, and using the evidence for verdict prediction raises Macro-F1 by 10-20 points over the baseline. These gains are consistent across different verdict granularities (2-class vs. 5-class) and model architectures. A qualitative analysis indicates that the decontextualized premises remain faithful to the original sources. Our work highlights the promise of reusing fact-checkers' evidence for automation and provides a large-scale resource of structured evidence from real-world fact-checks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

25 of 44 references.

References · 25

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  3. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  4. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  5. 2021A Survey on Automated Fact-Checkingcited by 376
  6. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
  7. 2018Stress Test Evaluation for Natural Language Inferencecited by 211
  8. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  9. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
  10. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  11. 2021Decontextualization: Making Sentences Stand-Alonecited by 101
  12. 2016Parsing Argumentation Structures in Persuasive Essayscited by 99
13 more
  1. 2024BM25S: Orders of magnitude faster lexical search via eager sparse scoringcited by 87
  2. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  3. 2024Molecular Facts: Desiderata for Decontextualization in LLM Fact Verificationcited by 42
  4. 2020Multi-Hop Fact Checking of Political Claimscited by 37
  5. 2023EX-FEVER: A Dataset for Multi-hop Explainable Fact Verificationcited by 36
  6. 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Researchcited by 35
  7. 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
  8. 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
  9. 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
  10. 2021Generating Fluent Fact Checking Explanations with Unsupervised Post-Editingcited by 15
  11. 2024Language Modeling with Editable External Knowledgecited by 9
  12. 2021Inscriptis -- A Python-based HTML to text conversion library optimized for knowledge extraction from the Webcited by 6
  13. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.