From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence
Not on the map. Why?
Abstract (arXiv)
Fact-checking articles encode rich supporting evidence and reasoning, yet this evidence remains largely inaccessible to automated verification systems due to unstructured presentation. We introduce PrimeFacts, a methodology and resource for extracting fine-grained evidence from full fact-checking articles. We compile 13,106 PolitiFact articles with claims, verdicts, and all referenced sources, and we identify 49,718 in-article hyperlinks as natural anchors to pinpoint key evidence. Our framework leverages large language models (LLMs) to rewrite these anchor sentences into stand-alone, context-independent premises and investigates the extraction of additional implicit evidence. In evaluations on cross-article evidence retrieval and claim verification, the extracted premises substantially improve performance. Decontextualized evidence yields higher retrievability, achieving up to a 30 percent relative gain in Mean Reciprocal Rank over verbatim sentences, and using the evidence for verdict prediction raises Macro-F1 by 10-20 points over the baseline. These gains are consistent across different verdict granularities (2-class vs. 5-class) and model architectures. A qualitative analysis indicates that the decontextualized premises remain faithful to the original sources. Our work highlights the promise of reusing fact-checkers' evidence for automation and provides a large-scale resource of structured evidence from real-world fact-checks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
25 of 44 references.
References · 25
- 2025Qwen3 Technical Reportcited by 8,195
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2018Stress Test Evaluation for Natural Language Inferencecited by 211
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2021Decontextualization: Making Sentences Stand-Alonecited by 101
- 2016Parsing Argumentation Structures in Persuasive Essayscited by 99
13 more
- 2024BM25S: Orders of magnitude faster lexical search via eager sparse scoringcited by 87
- 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
- 2024Molecular Facts: Desiderata for Decontextualization in LLM Fact Verificationcited by 42
- 2020Multi-Hop Fact Checking of Political Claimscited by 37
- 2023EX-FEVER: A Dataset for Multi-hop Explainable Fact Verificationcited by 36
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Researchcited by 35
- 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2021Generating Fluent Fact Checking Explanations with Unsupervised Post-Editingcited by 15
- 2024Language Modeling with Editable External Knowledgecited by 9
- 2021Inscriptis -- A Python-based HTML to text conversion library optimized for knowledge extraction from the Webcited by 6
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.