Autonomation, Not Automation: Activities and Needs of European Fact-checkers as a Basis for Designing Human-Centered AI Systems
Not on the map. Why?
Abstract (arXiv)
To mitigate the negative effects of false information more effectively, the development of Artificial Intelligence (AI) systems to assist fact-checkers is needed. Nevertheless, the lack of focus on the needs of these stakeholders results in their limited acceptance and skepticism toward automating the whole fact-checking process. In this study, we conducted semi-structured in-depth interviews with Central European fact-checkers. Their activities and problems were analyzed using iterative content analysis. The most significant problems were validated with a survey of European fact-checkers, in which we collected 24 responses from 20 countries, i.e., 62% of active European signatories of the International Fact-Checking Network (IFCN). Our contributions include an in-depth examination of the variability of fact-checking work in non-English-speaking regions, which still remained largely uncovered. By aligning them with the knowledge from prior studies, we created conceptual models that help to understand the fact-checking processes. In addition, we mapped our findings on the fact-checkers' activities and needs to the relevant tasks for AI research, while providing a discussion on three AI tasks that were not covered by previous similar studies. The new opportunities identified for AI researchers and developers have implications for the focus of AI research in this domain.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 25 of its 115 references that are in the map. First posted on arXiv 22 Nov 2022.
Builds on
25 of 115 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 91
- 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
- 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 81
- 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
- 2021Automated Fact-Checking: A Surveycited by 55
- 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
13 more
- 2020Language Models as Fact Checkers?cited by 51
- 2020Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake Newscited by 48
- 2021Claim Matching Beyond English to Scale Global Fact-Checkingcited by 42
- 2020Fighting the COVID-19 Infodemic in Social Media: A Holistic Perspective and a Call to Armscited by 41
- 2020CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Mediacited by 25
- 2021Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claimscited by 16
- 2022Human and technological infrastructures of fact-checkingcited by 16
- 2019Automated Fact Checking in the News Roomcited by 13
- 2022Monant Medical Misinformation Dataset: Mapping Articles to Fact-Checked Claimscited by 10
- 2022CrowdChecked: Detecting Previously Fact-Checked Claims in Social Mediacited by 9
- 2020Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteriacited by 8
- 2022CsFEVER and CTKFacts: Acquiring Czech data for fact verificationcited by 6
- 2021Scalable Fact-checking with Human-in-the-Loopcited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 3; 2026: 2.
7 papers.
- 2023Multilingual Previously Fact-Checked Claim Retrievalcited by 32
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detectioncited by 6
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languagescited by 1
- 2025Civil Society in the Loop: Feedback-Driven Adaptation of (L)LM-Assisted Classification in an Open-Source Telegram Monitoring Toolcited by 0
- 2026MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Modelscited by 0
- 2026Ctrl-F-Resist. Practices, Challenges, and Technical Needs of Civil Society Organizations Monitoring the Far-Right Onlinecited by 0
- 2026Ctrl-F-Resist. Practices, Challenges, and Technical Needs of Civil Society Organizations Monitoring the Far-Right Online1 Sep 2026
- 2026MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Models18 Feb 2026
- 2025Civil Society in the Loop: Feedback-Driven Adaptation of (L)LM-Assisted Classification in an Open-Source Telegram Monitoring Tool9 Jul 2025
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languages29 Apr 2025
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detection4 Mar 2025
- 2024Generative Large Language Models in Automated Fact-Checking: A Survey2 Jul 2024
- 2023Multilingual Previously Fact-Checked Claim Retrieval13 May 2023