DS@GT at CheckThat! 2025: Exploring Retrieval and Reranking Pipelines for Scientific Claim Source Retrieval on Social Media Discourse
Not on the map. Why?
Abstract (arXiv)
Social media users often make scientific claims without citing where these claims come from, generating a need to verify these claims. This paper details work done by the DS@GT team for CLEF 2025 CheckThat! Lab Task 4b Scientific Claim Source Retrieval which seeks to find relevant scientific papers based on implicit references in tweets. Our team explored 6 different data augmentation techniques, 7 different retrieval and reranking pipelines, and finetuned a bi-encoder. Achieving an MRR@5 of 0.58, our team ranked 16th out of 30 teams for the CLEF 2025 CheckThat! Lab Task 4b, and improvement of 0.15 over the BM25 baseline of 0.43. Our code is available on Github at https://github.com/dsgt-arc/checkthat-2025-swd/tree/main/subtask-4b.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 19 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
6 of 19 references.
References · 6
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Taskscited by 136
- 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understandingcited by 17
- 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
- 2024rerankers: A Lightweight Python Library to Unify Ranking Methodscited by 8
Built on by
Not cited yet.