mlsanityData to 14 Oct 2026

Detecting Check-Worthy Claims in Political Debates, Speeches, and Interviews Using Audio Data

arXiv 2306.05535 ↗First posted 24 May 2023cs.CL cs.AI cs.IRcited by 7

Not on the map. Why?

Abstract (arXiv)

Developing tools to automatically detect check-worthy claims in political debates and speeches can greatly help moderators of debates, journalists, and fact-checkers. While previous work on this problem has focused exclusively on the text modality, here we explore the utility of the audio modality as an additional input. We create a new multimodal dataset (text and audio in English) containing 48 hours of speech from past political debates in the USA. We then experimentally demonstrate that, in the case of multiple speakers, adding the audio modality yields sizable improvements over using the text modality alone; moreover, an audio-only model could outperform a text-only one for a single speaker. With the aim to enable future research, we make all our data and code publicly available at https://github.com/petar-iv/audio-checkworthiness-detection.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 15 of its 36 references that are in the map. First posted on arXiv 24 May 2023.

Builds on

15 of 36 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  7. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  8. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
  9. 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
  10. 2020A Survey on Computational Propaganda Detectioncited by 70
  11. 2020Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Mediacited by 46
  12. 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
3 more
  1. 2019It Takes Nine to Smell a Rat: Neural Multi-Task Learning for Check-Worthiness Predictioncited by 14
  2. 2019Predicting the Leading Political Ideology of YouTube Channels Using Acoustic, Textual, and Metadata Informationcited by 9
  3. 2019Detecting Deception in Political Debates Using Acoustic and Textual Featurescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

  1. 2025Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mindcited by 8
  2. 2025Annotation Tool and Dataset for Fact-Checking Podcastscited by 2
  3. 2025ShortCheck: Checkworthiness Detection of Multilingual Short-Form Videoscited by 1
  4. 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platformscited by 1
  5. 2026Context-Aware Multimodal Claim Verification in Spoken Dialoguescited by 1
  6. 2026Retrieve-Refine-Calibrate: A Framework for Complex Claim Fact-Checkingcited by 0
  7. 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articlescited by 0