mlsanityData to 14 Oct 2026

A persistent accuracy ceiling in automated verbal deception detection

arXiv 2610.12118 ↗First posted 8 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated methods have been proposed to overcome the limitations of human verbal deception detection, but evidence remains fragmented across disciplines. We systematically reviewed 25 years of research (289 reports, 6,136 classification models) and meta-analyzed 3,653 models nested within 97 datasets. Pooled accuracy was 74.4% (95% CI: 71.2%-77.4%) with substantial heterogeneity. Accuracy was driven by methodological quality (ground truth, data source, class balance, evaluation procedure) more than by model complexity: the adoption of embeddings and large language models has not translated into improved predictive performance. Only 12.46% of reports used data with verifiable ground-truth, and only 23.96% of models were evaluated on independent data. The pooled accuracy aligns with meta-analyses of manual approaches, suggesting a ceiling of 70-75%, unlikely to be lifted by current research conventions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 110 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

14 of 110 references.

References · 14

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  4. 2018Model Cards for Model Reportingcited by 1,080
  5. 2020Open Source Software for Efficient and Transparent Reviewscited by 35
  6. 2023Pre-registration for Predictive Modelingcited by 13
  7. 2018The Mafiascum Dataset: A Large Text Corpus for Deception Detectioncited by 9
  8. 2022Spam Review Detection Using Deep Learningcited by 4
  9. 2021Deception detection in text and its relation to the cultural dimension of individualism/collectivismcited by 3
  10. 2021Confounds and Overestimations in Fake Review Detection: Experimentally Controlling for Product-Ownership and Data-Origincited by 1
  11. 2023Unmasking Falsehoods in Reviews: An Exploration of NLP Techniquescited by 1
  12. 2025When lies are mostly truthful: automated verbal deception detection for embedded liescited by 1
2 more
  1. 2025What if Deception Cannot be Detected? A Cross-Linguistic Study on the Limits of Deception Detection from Textcited by 1
  2. 2025Humans incorrectly reject confident accusatory AI judgmentscited by 1

Built on by

Not cited yet.