mlsanityData to 7 Oct 2026

How Entangled is Factuality and Deception in German?

arXiv 2409.20165 ↗First posted 30 Sep 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The statement "The earth is flat" is factually inaccurate, but if someone truly believes and argues in its favor, it is not deceptive. Research on deception detection and fact checking often conflates factual accuracy with the truthfulness of statements. This assumption makes it difficult to (a) study subtle distinctions and interactions between the two and (b) gauge their effects on downstream tasks. The belief-based deception framework disentangles these properties by defining texts as deceptive when there is a mismatch between what people say and what they truly believe. In this study, we assess if presumed patterns of deception generalize to German language texts. We test the effectiveness of computational models in detecting deception using an established corpus of belief-based argumentation. Finally, we gauge the impact of deception on the downstream task of fact checking and explore if this property confounds verification models. Surprisingly, our analysis finds no correlation with established cues of deception. Previous work claimed that computational models can outperform humans in deception detection accuracy, however, our experiments show that both traditional and state-of-the-art models struggle with the task, performing no better than random guessing. For fact checking, we find that Natural Language Inference-based verification performs worse on non-factual and deceptive content, while prompting Large Language Models for the same task is less sensitive to these properties.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 62 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

14 of 62 references.

References · 14

  1. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  2. 2021A Survey on Automated Fact-Checkingcited by 376
  3. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
  4. 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
  5. 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
  6. 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
  7. 2022Synthetic Disinformation Attacks on Automated Fact Verification Systemscited by 44
  8. 2018The Mafiascum Dataset: A Large Text Corpus for Deception Detectioncited by 8
  9. 2021Automatic Fake News Detection: Are Models Learning to Reason?cited by 7
  10. 2023To Tell The Truth: Language of Deception and Language Modelscited by 6
  11. 2024Can Factual Statements be Deceptive? The DeFaBel Corpus of Belief-based Deceptioncited by 4
  12. 2017Online Deception Detection Refueled by Real World Data Collectioncited by 3
2 more
  1. 2022Automatic Fake News Detection: Are current models "fact-checking" or "gut-checking"?cited by 3
  2. 2023UNIDECOR: A Unified Deception Corpus for Cross-Corpus Deception Detectioncited by 3

Built on by

Not cited yet.