Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
Not on the map. Why?
Abstract (arXiv)
Voice Authentication Systems (VAS) use unique vocal characteristics for verification. They are increasingly integrated into high-security sectors such as banking and healthcare. Despite their improvements using deep learning, they face severe vulnerabilities from sophisticated threats like deepfakes and adversarial attacks. The emergence of realistic voice cloning complicates detection, as systems struggle to distinguish authentic from synthetic audio. While anti-spoofing countermeasures (CMs) exist to mitigate these risks, many rely on static detection models that can be bypassed by novel adversarial methods, leaving a critical security gap. To demonstrate this vulnerability, we propose the Spectral Masking and Interpolation Attack (SMIA), a novel method that strategically manipulates inaudible frequency regions of AI-generated audio. By altering the voice in imperceptible zones to the human ear, SMIA creates adversarial samples that sound authentic while deceiving CMs. We conducted a comprehensive evaluation of our attack against state-of-the-art (SOTA) models across multiple tasks, under simulated real-world conditions. SMIA achieved a strong attack success rate (ASR) of at least 82% against combined VAS/CM systems, at least 97.5% against standalone speaker verification systems, and 100% against countermeasures. These findings conclusively demonstrate that current security postures are insufficient against adaptive adversarial attacks. This work highlights the urgent need for a paradigm shift toward next-generation defenses that employ dynamic, context-aware frameworks capable of evolving with the threat landscape.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 9 Sep 2025.
Builds on
21 of 55 references.
References · 21
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 273
- 2019AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Losscited by 192
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
- 2022FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversioncited by 80
- 2018StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networkscited by 78
9 more
- 2021End-to-End Spectro-Temporal Graph Attention Networks for Speaker Verification Anti-Spoofing and Speech Deepfake Detectioncited by 70
- 2017Deep Speaker: an End-to-End Neural Speaker Embedding Systemcited by 58
- 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
- 2024Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesiscited by 48
- 2023OpenVoice: Versatile Instant Voice Cloningcited by 32
- 2019Adversarial Attacks on Spoofing Countermeasures of automatic speaker verificationcited by 23
- 2021Raw Differentiable Architecture Search for Speech Deepfake and Spoofing Detectioncited by 22
- 2022Adversarial attacks and defenses in Speaker Recognition Systems: A surveycited by 6
- 2022Adversarial Transformation of Spoofing Attacks for Voice Biometricscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.