Multilingual Previously Fact-Checked Claim Retrieval
Not on the map. Why?
Abstract (arXiv)
Fact-checkers are often hampered by the sheer amount of online content that needs to be fact-checked. NLP can help them by retrieving already existing fact-checks relevant to the content being investigated. This paper introduces a new multilingual dataset -- MultiClaim -- for previously fact-checked claim retrieval. We collected 28k posts in 27 languages from social media, 206k fact-checks in 39 languages written by professional fact-checkers, as well as 31k connections between these two groups. This is the most extensive and the most linguistically diverse dataset of this kind to date. We evaluated how different unsupervised methods fare on this dataset and its various dimensions. We show that evaluating such a diverse dataset has its complexities and proper care needs to be taken before interpreting the results. We also evaluated a supervised fine-tuning approach, improving upon the unsupervised method significantly.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 13 May 2023.
Builds on
15 of 45 references.
References · 15
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
- 2020Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake Newscited by 48
- 2020Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Mediacited by 46
- 2021Claim Matching Beyond English to Scale Global Fact-Checkingcited by 42
- 2018The Rise of Guardians: Fact-checking URL Recommendation to Combat Fake Newscited by 24
- 2021Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Documentcited by 19
- 2021The Role of Context in Detecting Previously Fact-Checked Claimscited by 17
- 2021Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claimscited by 16
- 2021Categorising Fine-to-Coarse Grained Misinformation: An Empirical Study of COVID-19 Infodemiccited by 9
3 more
- 2022CrowdChecked: Detecting Previously Fact-Checked Claims in Social Mediacited by 9
- 2022Autonomation, Not Automation: Activities and Needs of European Fact-checkers as a Basis for Designing Human-Centered AI Systemscited by 7
- 2022Harnessing Abstractive Summarization for Fact-Checked Claim Detectioncited by 5
Built on by
Citing papers per year: 2024: 10; 2025: 17; 2026: 5.
32 papers.
Sort:
By area:
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Researchcited by 35
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 24
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
- 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 11
- 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
- 2025MultiClaimNet: A Massively Multilingual Dataset of Fact-Checked Claim Clusterscited by 7
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detectioncited by 6
- 2024Soft Language Prompts for Language Transfercited by 5
- 2024MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Modelscited by 4
- 2025HintsOfTruth: A Multimodal Checkworthiness Detection Dataset with Real and Synthetic Claimscited by 4
- 2025When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verificationcited by 3
20 more
- 2024Multilingual Models for Check-Worthy Social Media Posts Detectioncited by 2
- 2026BLUFF: Benchmarking the Detection of False and Synthetic Content across 58 Low-Resource Languagescited by 2
- 2025Word2winners at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 1
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languagescited by 1
- 2025Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approachescited by 1
- 2025Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detectioncited by 1
- 2026MultiCaption: Detecting disinformation using multilingual visual claimscited by 1
- 2026DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialectscited by 1
- 2024ExU: AI Models for Examining Multilingual Disinformation Narratives and Understanding their Spreadcited by 0
- 2024MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Modelscited by 0
- 2025TIFIN India at SemEval-2025: Harnessing Translation to Overcome Multilingual IR Challenges in Fact-Checked Claim Retrievalcited by 0
- 2025Duluth at SemEval-2025 Task 7: TF-IDF with Optimized Vector Dimensions for Multilingual Fact-Checked Claim Retrievalcited by 0
- 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrievalcited by 0
- 2025fact check AI at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-checked Claim Retrievalcited by 0
- 2025UWBa at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 0
- 2025o-MEGA: Optimized Methods for Explanation Generation and Analysiscited by 0
- 2025Agent-based Automated Claim Matching with Instruction-following LLMscited by 0
- 2025MultiMind at SemEval-2025 Task 7: Crosslingual Fact-Checked Claim Retrieval via Multi-Source Alignmentcited by 0
- 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Groundingcited by 0
- 2026MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Modelscited by 0
- 2026DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects7 Apr 2026
- 2026BLUFF: Benchmarking the Detection of False and Synthetic Content across 58 Low-Resource Languages28 Feb 2026
- 2026MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Models18 Feb 2026
- 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Grounding3 Feb 2026
- 2026MultiCaption: Detecting disinformation using multilingual visual claims16 Jan 2026
- 2025MultiMind at SemEval-2025 Task 7: Crosslingual Fact-Checked Claim Retrieval via Multi-Source Alignment24 Dec 2025
- 2025Agent-based Automated Claim Matching with Instruction-following LLMs27 Oct 2025
- 2025o-MEGA: Optimized Methods for Explanation Generation and Analysis30 Sep 2025
- 2025Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detection29 Sep 2025
- 2025UWBa at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval13 Aug 2025
- 2025fact check AI at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-checked Claim Retrieval5 Aug 2025
- 2025When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification28 Jul 2025
20 more
- 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrieval12 Jun 2025
- 2025Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approaches28 May 2025
- 2025Duluth at SemEval-2025 Task 7: TF-IDF with Optimized Vector Dimensions for Multilingual Fact-Checked Claim Retrieval19 May 2025
- 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval15 May 2025
- 2025A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languages29 Apr 2025
- 2025TIFIN India at SemEval-2025: Harnessing Translation to Overcome Multilingual IR Challenges in Fact-Checked Claim Retrieval23 Apr 2025
- 2025MultiClaimNet: A Massively Multilingual Dataset of Fact-Checked Claim Clusters28 Mar 2025
- 2025Word2winners at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval12 Mar 2025
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detection4 Mar 2025
- 2025HintsOfTruth: A Multimodal Checkworthiness Detection Dataset with Real and Synthetic Claims17 Feb 2025
- 2024A Guide to Misinformation Detection Data and Evaluation7 Nov 2024
- 2024MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models16 Oct 2024
- 2024Claim Verification in the Age of Large Language Models: A Survey26 Aug 2024
- 2024Multilingual Models for Check-Worthy Social Media Posts Detection13 Aug 2024
- 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?18 Jul 2024
- 2024Generative Large Language Models in Automated Fact-Checking: A Survey2 Jul 2024
- 2024Soft Language Prompts for Language Transfer2 Jul 2024
- 2024ExU: AI Models for Examining Multilingual Disinformation Narratives and Understanding their Spread30 May 2024
- 2024MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models21 Feb 2024
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Research22 Jan 2024
- 2024Claim Detection for Automated Fact-checking: A Survey on Monolingual, Multilingual and Cross-Lingual Researchcited by 35
- 2024Claim Verification in the Age of Large Language Models: A Surveycited by 24
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
- 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 11
- 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
- 2025MultiClaimNet: A Massively Multilingual Dataset of Fact-Checked Claim Clusterscited by 7
- 2025Large Language Models for Multilingual Previously Fact-Checked Claim Detectioncited by 6
- 2024Soft Language Prompts for Language Transfercited by 5
- 2024MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Modelscited by 4
- 2025HintsOfTruth: A Multimodal Checkworthiness Detection Dataset with Real and Synthetic Claimscited by 4
- 2025When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verificationcited by 3
12 most cited of 30 All 30 (JSON)
- 2026BLUFF: Benchmarking the Detection of False and Synthetic Content across 58 Low-Resource Languages28 Feb 2026
- 2026MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Models18 Feb 2026
- 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Grounding3 Feb 2026
- 2026MultiCaption: Detecting disinformation using multilingual visual claims16 Jan 2026
- 2025MultiMind at SemEval-2025 Task 7: Crosslingual Fact-Checked Claim Retrieval via Multi-Source Alignment24 Dec 2025
- 2025o-MEGA: Optimized Methods for Explanation Generation and Analysis30 Sep 2025
- 2025Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detection29 Sep 2025
- 2025UWBa at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval13 Aug 2025
- 2025fact check AI at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-checked Claim Retrieval5 Aug 2025
- 2025When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification28 Jul 2025
- 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrieval12 Jun 2025
- 2025Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approaches28 May 2025
12 newest of 30 All 30 (JSON)