mlsanityData to 7 Oct 2026

HYBRINFOX at CheckThat! 2024 -- Task 1: Enhancing Language Models with Structured Information for Check-Worthiness Estimation

arXiv 2407.03850 ↗First posted 4 Jul 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper summarizes the experiments and results of the HYBRINFOX team for the CheckThat! 2024 - Task 1 competition. We propose an approach enriching Language Models such as RoBERTa with embeddings produced by triples (subject ; predicate ; object) extracted from the text sentences. Our analysis of the developmental data shows that this method improves the performance of Language Models alone. On the evaluation data, its best performance was in English, where it achieved an F1 score of 71.1 and ranked 12th out of 27 candidates. On the other languages (Dutch and Arabic), it obtained more mixed results. Future research tracks are identified toward adapting this processing pipeline to more recent Large Language Models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 4 Jul 2024.

Builds on

13 of 24 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  6. 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
  7. 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
  8. 2018Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthinesscited by 41
  9. 2018ClaimRank: Detecting Check-Worthy Claims in Arabic and Englishcited by 27
  10. 2020A Benchmark Dataset of Check-worthy Factual Claimscited by 27
  11. 2020Multi2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERTcited by 26
  12. 2024FactFinders at CheckThat! 2024: Refining Check-worthy Statement Detection with LLMs through Data Pruningcited by 6
1 more
  1. 2024NELA-PS: A Dataset of Pink Slime News Articles for the Study of Local News Ecosystemscited by 3

Built on by

Not cited yet.