Can Current Detectors Catch Face-to-Voice Deepfake Attacks?
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of generative models has enabled the creation of increasingly stealthy synthetic voices, commonly referred to as audio deepfakes. A recent technique, FOICE [USENIX'24], demonstrates a particularly alarming capability: generating a victim's voice from a single facial image, without requiring any voice sample. By exploiting correlations between facial and vocal features, FOICE produces synthetic voices realistic enough to bypass industry-standard authentication systems, including WeChat Voiceprint and Microsoft Azure. This raises serious security concerns, as facial images are far easier for adversaries to obtain than voice samples, dramatically lowering the barrier to large-scale attacks. In this work, we investigate two core research questions: (RQ1) can state-of-the-art audio deepfake detectors reliably detect FOICE-generated speech under clean and noisy conditions, and (RQ2) whether fine-tuning these detectors on FOICE data improves detection without overfitting, thereby preserving robustness to unseen voice generators such as SpeechT5. Our study makes three contributions. First, we present the first systematic evaluation of FOICE detection, showing that leading detectors consistently fail under both standard and noisy conditions. Second, we introduce targeted fine-tuning strategies that capture FOICE-specific artifacts, yielding significant accuracy improvements. Third, we assess generalization after fine-tuning, revealing trade-offs between specialization to FOICE and robustness to unseen synthesis pipelines. These findings expose fundamental weaknesses in today's defenses and motivate new architectures and training protocols for next-generation audio deepfake detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 23 Oct 2025.
Builds on
16 of 30 references.
References · 16
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2021SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processingcited by 180
- 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 162
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2023AI-Synthesized Voice Detection Using Neural Vocoder Artifactscited by 41
- 2024A Survey on Speech Deepfake Detectioncited by 27
- 2024Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detectioncited by 25
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
4 more
Built on by
Not cited yet.