SciClaimSeekers at CheckThat! 2026: Retrieving Scientific Sources for Social Media Claims with LLM Reranking
Not on the map. Why?
Abstract (arXiv)
Scientific claims often spread on social media faster than they can be verified, while posts rarely link to the original scholarly sources. To tackle this problem this paper presents system called SciClaimSeekers, a retrieval and reranking framework by combining BM25 and zero-shot multilingual E5 retrieval with Reciprocal Rank Fusion (k=60), followed by Qwen2.5-14B-Instruct pointwise reranking. The pipeline reaches 64.36% MRR@5 on the English development set a 13.67-point jump over BM25 and 10.17 points over the unranked hybrid and 64.39% on the official test set, in the CLEF-2026 CheckThat! Task 1 evaluation. Our experiment suggests that large pre-trained models, when combined into a careful pipeline, can be competitive with fine-tuned approaches on this task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
18 of 31 references.
References · 18
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 376
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
- 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 272
- 2023Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labelscited by 86
- 2023RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Modelscited by 70
6 more
- 2022An Analysis of Fusion Functions for Hybrid Retrievalcited by 51
- 2019A Hybrid Retrieval-Generation Neural Conversation Modelcited by 18
- 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
- 2025Deep Retrieval at CheckThat! 2025: Identifying Scientific Papers from Implicit Social Media Mentions via Hybrid Retrieval and Re-Rankingcited by 1
- 2025AIRwaves at CheckThat! 2025: Retrieving Scientific Sources for Implicit Claims on Social Media with Dual Encoders and Neural Re-Rankingcited by 1
Built on by
Not cited yet.