# Warning: Humans Cannot Reliably Detect Speech Deepfakes

arXiv: https://arxiv.org/abs/2301.07829 · HTML: https://mlsanity.com/paper/2301.07829/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jan 2023.

## Built on by (most cited first, 20 of 20)

- [GPT-4o System Card](https://mlsanity.com/paper/2410.21276/) (2024)
- [As Good As A Coin Toss: Human detection of AI-generated images, videos, audio, and audiovisual stimuli](https://mlsanity.com/paper/2403.16760/) (2024)
- [Speech DF Arena: A Leaderboard for Speech DeepFake Detection Models](https://mlsanity.com/paper/2509.02859/) (2025)
- [People are poorly equipped to detect AI-powered voice clones](https://mlsanity.com/paper/2410.03791/) (2024)
- [Non-Consensual Synthetic Intimate Imagery: Prevalence, Attitudes, and Knowledge in 10 Countries](https://mlsanity.com/paper/2402.01721/) (2024)
- [Unmasking Illusions: Understanding Human Perception of Audiovisual Deepfakes](https://mlsanity.com/paper/2405.04097/) (2024)
- [Text-To-Speech Synthesis In The Wild](https://mlsanity.com/paper/2409.08711/) (2024)
- [Deepfakes and Higher Education: A Research Agenda and Scoping Review of Synthetic Media](https://mlsanity.com/paper/2404.15601/) (2024)
- [RU-AI: A Large Multimodal Dataset for Machine-Generated Content Detection](https://mlsanity.com/paper/2406.04906/) (2024)
- [Disentangling Speaker Traits for Deepfake Source Verification via Chebyshev Polynomial and Riemannian Metric Learning](https://mlsanity.com/paper/2603.21875/) (2026)
- [Linguistic traces of stochastic empathy in language models](https://mlsanity.com/paper/2410.01675/) (2024)
- [Acoustic and perceptual differences between standard and accented speech and their voice clones](https://mlsanity.com/paper/2604.01562/) (2026)
- [V.O.I.C.E (Voice, Ownership, Identity, Control, Expression): Risk Taxonomy of Synthetic Voice Generation From Empirical Data](https://mlsanity.com/paper/2604.24794/) (2026)
- [Voice "Cloning" is Style Transfer](https://mlsanity.com/paper/2605.16578/) (2026)
- [Eroding Trust in Real Speech: A Large-Scale Study of Human Audio Deepfake Perception](https://mlsanity.com/paper/2605.26136/) (2026)
- [Half-Truth Audio Detection and Localisation: A Lightweight Cross-Attentive Architecture and a Cross-Corpus Diagnostic Study](https://mlsanity.com/paper/2605.29531/) (2026)
- [What You Train Is What You Get: Gender Bias, Training Composition, and Post-Hoc Mitigation in Audio Deepfake Detection](https://mlsanity.com/paper/2607.09891/) (2026)
- [The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprints](https://mlsanity.com/paper/2608.07980/) (2026)
- [A survey of AI-generated voices and their detection](https://mlsanity.com/paper/2608.15411/) (2026)
- [GLAD: Global-Local Adaptive Detector for Robust Speech Deepfake Detection](https://mlsanity.com/paper/2609.35411/) (2026)

## Abstract (arXiv)

Speech deepfakes are artificial voices generated by machine learning models. Previous literature has highlighted deepfakes as one of the biggest security threats arising from progress in artificial intelligence due to their potential for misuse. However, studies investigating human detection capabilities are limited. We presented genuine and deepfake audio to n = 529 individuals and asked them to identify the deepfakes. We ran our experiments in English and Mandarin to understand if language affects detection performance and decision-making rationale. We found that detection capability is unreliable. Listeners only correctly spotted the deepfakes 73% of the time, and there was no difference in detectability between the two languages. Increasing listener awareness by providing examples of speech deepfakes only improves results slightly. As speech synthesis algorithms improve and become more realistic, we can expect the detection task to become harder. The difficulty of detecting speech deepfakes confirms their potential for misuse and signals that defenses against this threat are needed.
