mlsanityData to 14 Oct 2026

Autonomation, Not Automation: Activities and Needs of European Fact-checkers as a Basis for Designing Human-Centered AI Systems

arXiv 2211.12143 ↗First posted 22 Nov 2022cs.CY cs.AI cs.HCcited by 7

Not on the map. Why?

Abstract (arXiv)

To mitigate the negative effects of false information more effectively, the development of Artificial Intelligence (AI) systems to assist fact-checkers is needed. Nevertheless, the lack of focus on the needs of these stakeholders results in their limited acceptance and skepticism toward automating the whole fact-checking process. In this study, we conducted semi-structured in-depth interviews with Central European fact-checkers. Their activities and problems were analyzed using iterative content analysis. The most significant problems were validated with a survey of European fact-checkers, in which we collected 24 responses from 20 countries, i.e., 62% of active European signatories of the International Fact-Checking Network (IFCN). Our contributions include an in-depth examination of the variability of fact-checking work in non-English-speaking regions, which still remained largely uncovered. By aligning them with the knowledge from prior studies, we created conceptual models that help to understand the fact-checking processes. In addition, we mapped our findings on the fact-checkers' activities and needs to the relevant tasks for AI research, while providing a discussion on three AI tasks that were not covered by previous similar studies. The new opportunities identified for AI researchers and developers have implications for the focus of AI research in this domain.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 25 of its 115 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

25 of 115 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  4. 2021A Survey on Automated Fact-Checkingcited by 378
  5. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  6. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  7. 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 91
  8. 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
  9. 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 81
  10. 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
  11. 2021Automated Fact-Checking: A Surveycited by 55
  12. 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
13 more
  1. 2020Language Models as Fact Checkers?cited by 51
  2. 2020Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake Newscited by 48
  3. 2021Claim Matching Beyond English to Scale Global Fact-Checkingcited by 42
  4. 2020Fighting the COVID-19 Infodemic in Social Media: A Holistic Perspective and a Call to Armscited by 41
  5. 2020CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Mediacited by 25
  6. 2021Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claimscited by 16
  7. 2022Human and technological infrastructures of fact-checkingcited by 16
  8. 2019Automated Fact Checking in the News Roomcited by 13
  9. 2022Monant Medical Misinformation Dataset: Mapping Articles to Fact-Checked Claimscited by 10
  10. 2022CrowdChecked: Detecting Previously Fact-Checked Claims in Social Mediacited by 9
  11. 2020Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteriacited by 8
  12. 2022CsFEVER and CTKFacts: Acquiring Czech data for fact verificationcited by 6
  13. 2021Scalable Fact-checking with Human-in-the-Loopcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 3; 2026: 2.

7 papers.