DS@GT at CheckThat! 2025: Ensemble Methods for Detection of Scientific Discourse on Social Media
Not on the map. Why?
Abstract (arXiv)
In this paper, we, as the DS@GT team for CLEF 2025 CheckThat! Task 4a Scientific Web Discourse Detection, present the methods we explored for this task. For this multiclass classification task, we determined if a tweet contained a scientific claim, a reference to a scientific study or publication, and/or mentions of scientific entities, such as a university or a scientist. We present 3 modeling approaches for this task: transformer finetuning, few-shot prompting of LLMs, and a combined ensemble model whose design was informed by earlier experiments. Our team placed 7th in the competition, achieving a macro-averaged F1 score of 0.8611, an improvement over the DeBERTaV3 baseline of 0.8375. Our code is available on Github at https://github.com/dsgt-arc/checkthat-2025-swd/tree/main/subtask-4a.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
7 of 14 references.
References · 7
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 70
- 2020TweetsCOV19 -- A Knowledge Base of Semantically Annotated Tweets about the COVID-19 Pandemiccited by 9
- 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
- 2018TweetsKB: A Public and Large-Scale RDF Corpus of Annotated Tweetscited by 6
Built on by
Not cited yet.