mlsanityData to 14 Oct 2026

SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval

arXiv 2505.10740 ↗First posted 15 May 2025cs.CL cs.IRcited by 11

Not on the map. Why?

Abstract (arXiv)

The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To address this gap, we conducted a shared task on multilingual claim retrieval at SemEval 2025, aimed at identifying fact-checked claims that match newly encountered claims expressed in social media posts across different languages. The task includes two subtracks: (1) a monolingual track, where social posts and claims are in the same language, and (2) a crosslingual track, where social posts and claims might be in different languages. A total of 179 participants registered for the task contributing to 52 test submissions. 23 out of 31 teams have submitted their system papers. In this paper, we report the best-performing systems as well as the most common and the most effective approaches across both subtracks. This shared task, along with its dataset and participating systems, provides valuable insights into multilingual claim retrieval and automated fact-checking, supporting future research in this field.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 27 of its 73 references that are in the map. First posted on arXiv 15 May 2025.

Builds on

27 of 73 references.

References · 27

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  3. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  4. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  5. 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
  6. 2021A Survey on Automated Fact-Checkingcited by 378
  7. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  8. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  9. 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
  10. 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
  11. 2020GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Mediacited by 109
  12. 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108
15 more
  1. 2020Explainable Automated Fact-Checking: A Surveycited by 83
  2. 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
  3. 2019The Limitations of Stylometry for Detecting Machine-Generated Fake Newscited by 63
  4. 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
  5. 2021Automated Fact-Checking: A Surveycited by 55
  6. 2024IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languagescited by 52
  7. 2020Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake Newscited by 48
  8. 2021Claim Matching Beyond English to Scale Global Fact-Checkingcited by 42
  9. 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)cited by 35
  10. 2023Multilingual Previously Fact-Checked Claim Retrievalcited by 32
  11. 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
  12. 2020A Benchmark Dataset of Check-worthy Factual Claimscited by 27
  13. 2023Benchmarking the Generation of Fact Checking Explanationscited by 25
  14. 2021The Role of Context in Detecting Previously Fact-Checked Claimscited by 17
  15. 2025Word2winners at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 2.

11 papers.

  1. 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
  2. 2025Debiasing Multilingual LLMs in Cross-lingual Latent Spacecited by 2
  3. 2025Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approachescited by 1
  4. 2025Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detectioncited by 1
  5. 2025Duluth at SemEval-2025 Task 7: TF-IDF with Optimized Vector Dimensions for Multilingual Fact-Checked Claim Retrievalcited by 0
  6. 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrievalcited by 0
  7. 2025fact check AI at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-checked Claim Retrievalcited by 0
  8. 2025UWBa at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 0
  9. 2025o-MEGA: Optimized Methods for Explanation Generation and Analysiscited by 0
  10. 2025MultiMind at SemEval-2025 Task 7: Crosslingual Fact-Checked Claim Retrieval via Multi-Source Alignmentcited by 0
  11. 2026SEEK: Semantic Evidence Extraction via Adaptive ChunKing for Multilingual Fact-Checkingcited by 0