Duluth at SemEval-2025 Task 7: TF-IDF with Optimized Vector Dimensions for Multilingual Fact-Checked Claim Retrieval
Not on the map. Why?
Abstract (arXiv)
This paper presents the Duluth approach to the SemEval-2025 Task 7 on Multilingual and Crosslingual Fact-Checked Claim Retrieval. We implemented a TF-IDF-based retrieval system with experimentation on vector dimensions and tokenization strategies. Our best-performing configuration used word-level tokenization with a vocabulary size of 15,000 features, achieving an average success@10 score of 0.78 on the development set and 0.69 on the test set across ten languages. Our system showed stronger performance on higher-resource languages but still lagged significantly behind the top-ranked system, which achieved 0.96 average success@10. Our findings suggest that though advanced neural architectures are increasingly dominant in multilingual retrieval tasks, properly optimized traditional methods like TF-IDF remain competitive baselines, especially in limited compute resource scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
9 of 11 references.
References · 9
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
- 2016FastText.zip: Compressing text classification modelscited by 335
- 2018Learning Word Vectors for 157 Languagescited by 280
- 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
- 2021A Primer on Pretrained Multilingual Language Modelscited by 49
- 2023Multilingual Previously Fact-Checked Claim Retrievalcited by 32
- 2025SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrievalcited by 11
Built on by
Not cited yet.