mlsanityData to 7 Oct 2026

The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval

arXiv 2503.14828 ↗First posted 19 Mar 2025cs.CL cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

The CheckThat! lab aims to advance the development of innovative technologies designed to identify and counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions focused on key tasks in the information verification pipeline, including check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has expanded its scope to address auxiliary tasks that support research and decision-making in verification. In the 2025 edition, the lab revisits core verification tasks while also considering auxiliary challenges. Task 1 focuses on the identification of subjectivity (a follow-up from CheckThat! 2024), Task 2 addresses claim normalization, Task 3 targets fact-checking numerical claims, and Task 4 explores scientific web discourse processing. These tasks present challenging classification and retrieval problems at both the document and span levels, including multilingual settings.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 19 Mar 2025.

Builds on

31 of 53 references.

References · 31

  1. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  2. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  3. 2021A Survey on Automated Fact-Checkingcited by 376
  4. 2020CORD-19: The COVID-19 Open Research Datasetcited by 179
  5. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  6. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  7. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  8. 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 79
  9. 2017SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumourscited by 77
  10. 2018RumourEval 2019: Determining Rumour Veracity and Support for Rumourscited by 74
  11. 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
  12. 2018A Retrospective Analysis of the Fake News Challenge Stance Detection Taskcited by 49
19 more
  1. 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
  2. 2022GERE: Generative Evidence Retrieval for Fact Verificationcited by 38
  3. 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
  4. 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
  5. 2019SemEval-2019 Task 8: Fact Checking in Community Question Answering Forumscited by 18
  6. 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checkingcited by 17
  7. 2024FactCheck Editor: Multilingual Text Editor with End-to-End fact-checkingcited by 12
  8. 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
  9. 2022Automated Content Moderation Increases Adherence to Community Guidelinescited by 10
  10. 2024What Makes Medical Claims (Un)Verifiable? Analyzing Entity and Relation Properties for Fact Verificationcited by 10
  11. 2024Multimodal Fact-Checking with Vision Language Models: A Probing Classifier based Solution with Embedding Strategiescited by 10
  12. 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
  13. 2024SubjECTive-QA: Measuring Subjectivity in Earnings Call Transcripts' QA Through Six-Dimensional Feature Analysiscited by 8
  14. 2023Findings of Factify 2: Multimodal Fake News Detectioncited by 7
  15. 2022MM-Claims: A Dataset for Multimodal Claim Detection in Social Mediacited by 6
  16. 2023An Entity-based Claim Extraction Pipeline for Real-world Biomedical Fact-checkingcited by 4
  17. 2023Overview of the CLAIMSCAN-2023: Uncovering Truth in Social Media through Claim Detection and Identification of Claim Spanscited by 4
  18. 2024Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysiscited by 4
  19. 2024Are Fact-Checking Tools Helpful? An Exploration of the Usability of Google Fact Checkcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 12; 2026: 2.

14 papers.

Sort:

  1. 2025DS@GT at CheckThat! 2025: Evaluating Context and Tokenization Strategies for Numerical Fact Verificationcited by 2
  2. 2025Deep Retrieval at CheckThat! 2025: Identifying Scientific Papers from Implicit Social Media Mentions via Hybrid Retrieval and Re-Rankingcited by 1
  3. 2025CEA-LIST at CheckThat! 2025: Evaluating LLMs as Detectors of Bias and Opinion in Textcited by 1
  4. 2025AIRwaves at CheckThat! 2025: Retrieving Scientific Sources for Implicit Claims on Social Media with Dual Encoders and Neural Re-Rankingcited by 1
  5. 2025DS@GT at CheckThat! 2025: Detecting Subjectivity via Transfer-Learning and Corrective Data Augmentationcited by 0
  6. 2025AI Wizards at CheckThat! 2025: Enhancing Transformer-Based Embeddings with Sentiment for Subjectivity Detection in News Articlescited by 0
  7. 2025QU-NLP at CheckThat! 2025: Multilingual Subjectivity in News Articles Detection using Feature-Augmented Transformer Models with Sequential Cross-Lingual Fine-Tuningcited by 0
  8. 2025TurQUaz at CheckThat! 2025: Debating Large Language Models for Scientific Web Discourse Detectioncited by 0
  9. 2025DS@GT at CheckThat! 2025: A Simple Retrieval-First, LLM-Backed Framework for Claim Normalizationcited by 0
  10. 2025AKCIT-FN at CheckThat! 2025: Switching Fine-Tuned SLMs and LLM Prompting for Multilingual Claim Normalizationcited by 0
  11. 2025XplaiNLP at CheckThat! 2025: Multilingual Subjectivity Detection with Finetuned Transformers and Prompt-Based Inference with Large Language Modelscited by 0
  12. 2025Reasoning-Guided Claim Normalization for Noisy Multilingual Social Media Postscited by 0
2 more
  1. 2026Not All Subjectivity Is the Same! Defining Desiderata for the Evaluation of Subjectivity in NLPcited by 0
  2. 2026Relational Linear Properties in Language Models: An Empirical Investigationcited by 0