The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who
Not on the map. Why?
Abstract (arXiv)
Automated fact-checking is often presented as an epistemic tool that fact-checkers, social media consumers, and other stakeholders can use to fight misinformation. Nevertheless, few papers thoroughly discuss how. We document this by analysing 100 highly-cited papers, and annotating epistemic elements related to intended use, i.e., means, ends, and stakeholders. We find that narratives leaving out some of these aspects are common, that many papers propose inconsistent means and ends, and that the feasibility of suggested strategies rarely has empirical backing. We argue that this vagueness actively hinders the technology from reaching its goals, as it encourages overclaiming, limits criticism, and prevents stakeholder feedback. Accordingly, we provide several recommendations for thinking and writing about the use of fact-checking artefacts.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 27 of its 94 references that are in the map. First posted on arXiv 27 Apr 2023.
Builds on
27 of 94 references.
References · 27
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
- 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 209
- 2022Do Users Write More Insecure Code with AI Assistants?cited by 192
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2016Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussionscited by 110
- 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
- 2020Explainable Automated Fact-Checking: A Surveycited by 83
- 2017A Stylometric Inquiry into Hyperpartisan and Fake Newscited by 82
15 more
- 2017SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumourscited by 77
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2019The Limitations of Stylometry for Detecting Machine-Generated Fake Newscited by 63
- 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
- 2020Generating Fact Checking Briefscited by 50
- 2021Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLPcited by 47
- 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
- 2018Integrating Stance Detection and Fact Checking in a Unified Corpuscited by 41
- 2020What Can We Do to Improve Peer Review in NLP?cited by 32
- 2020Give Me Convenience and Give Her Death: Who Should Decide What Uses of NLP are Appropriate, and on What Basis?cited by 27
- 2022Human Interpretation of Saliency-based Explanation Over Textcited by 25
- 2022On the Ethical Considerations of Text Simplificationcited by 20
- 2022Crowdsourced Fact-Checking at Twitter: How Does the Crowd Compare With Experts?cited by 16
- 2020Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incelscited by 15
- 2023Opening up Minds with Argumentative Dialoguescited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 6; 2026: 6.
19 papers.
Sort:
By area:
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 42
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2024Missci: Reconstructing Fallacies in Misrepresented Sciencecited by 14
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languagescited by 11
- 2024Generating Media Background Checks for Automated Source Critical Reasoningcited by 10
- 2024"Image, Tell me your story!" Predicting the original meta-context of visual misinformationcited by 4
- 2025Attacks by Content: Automated Fact-checking is an AI Security Issuecited by 4
- 2026RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluationcited by 3
- 2024Multilingual Topic Classification in X: Dataset and Analysiscited by 1
7 more
- 2025Explaining Sources of Uncertainty in Automated Fact-Checkingcited by 1
- 2025Social Good or Scientific Curiosity? Uncovering the Research Framing Behind NLP Artefactscited by 1
- 2026Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Datasetcited by 0
- 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claimscited by 0
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 IIcited by 0
- 2026MEDIAREF: A Public Knowledge Store for Media Background Checkscited by 0
- 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?cited by 0
- 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?31 Aug 2026
- 2026MEDIAREF: A Public Knowledge Store for Media Background Checks2 Jul 2026
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II27 Mar 2026
- 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims27 Mar 2026
- 2026Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Dataset12 Jan 2026
- 2026RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation7 Jan 2026
- 2025Attacks by Content: Automated Fact-checking is an AI Security Issue13 Oct 2025
- 2025Social Good or Scientific Curiosity? Uncovering the Research Framing Behind NLP Artefacts24 May 2025
- 2025Explaining Sources of Uncertainty in Automated Fact-Checking23 May 2025
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking13 Feb 2025
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation7 Feb 2025
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages14 Jan 2025
7 more
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Task31 Oct 2024
- 2024Multilingual Topic Classification in X: Dataset and Analysis4 Oct 2024
- 2024Generating Media Background Checks for Automated Source Critical Reasoning1 Sep 2024
- 2024"Image, Tell me your story!" Predicting the original meta-context of visual misinformation19 Aug 2024
- 2024Missci: Reconstructing Fallacies in Misrepresented Science5 Jun 2024
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models6 Jan 2024
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Web22 May 2023
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 88
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2024Missci: Reconstructing Fallacies in Misrepresented Sciencecited by 14
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languagescited by 11
- 2024"Image, Tell me your story!" Predicting the original meta-context of visual misinformationcited by 4
- 2025Attacks by Content: Automated Fact-checking is an AI Security Issuecited by 4
- 2026RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluationcited by 3
- 2024Multilingual Topic Classification in X: Dataset and Analysiscited by 1
- 2025Explaining Sources of Uncertainty in Automated Fact-Checkingcited by 1
- 2025Social Good or Scientific Curiosity? Uncovering the Research Framing Behind NLP Artefactscited by 1
12 most cited of 16 All 16 (JSON)
- 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?31 Aug 2026
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II27 Mar 2026
- 2026ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims27 Mar 2026
- 2026Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Dataset12 Jan 2026
- 2026RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation7 Jan 2026
- 2025Attacks by Content: Automated Fact-checking is an AI Security Issue13 Oct 2025
- 2025Social Good or Scientific Curiosity? Uncovering the Research Framing Behind NLP Artefacts24 May 2025
- 2025Explaining Sources of Uncertainty in Automated Fact-Checking23 May 2025
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking13 Feb 2025
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages14 Jan 2025
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Task31 Oct 2024
- 2024Multilingual Topic Classification in X: Dataset and Analysis4 Oct 2024
12 newest of 16 All 16 (JSON)