mlsanityData to 14 Oct 2026

DS@GT at CheckThat! 2025: Ensemble Methods for Detection of Scientific Discourse on Social Media

arXiv 2507.06205 ↗First posted 8 Jul 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we, as the DS@GT team for CLEF 2025 CheckThat! Task 4a Scientific Web Discourse Detection, present the methods we explored for this task. For this multiclass classification task, we determined if a tweet contained a scientific claim, a reference to a scientific study or publication, and/or mentions of scientific entities, such as a university or a scientist. We present 3 modeling approaches for this task: transformer finetuning, few-shot prompting of LLMs, and a combined ensemble model whose design was informed by earlier experiments. Our team placed 7th in the competition, achieving a macro-averaged F1 score of 0.8611, an improvement over the DeBERTaV3 baseline of 0.8375. Our code is available on Github at https://github.com/dsgt-arc/checkthat-2025-swd/tree/main/subtask-4a.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

7 of 14 references.

References · 7

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  3. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  4. 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 70
  5. 2020TweetsCOV19 -- A Knowledge Base of Semantically Annotated Tweets about the COVID-19 Pandemiccited by 9
  6. 2022SciTweets -- A Dataset and Annotation Framework for Detecting Scientific Online Discoursecited by 9
  7. 2018TweetsKB: A Public and Large-Scale RDF Corpus of Annotated Tweetscited by 6

Built on by

Not cited yet.