mlsanityData to 13 Oct 2026

Defend Data Poisoning Attacks on Voice Authentication

arXiv 2209.04547 ↗First posted 9 Sep 2022cs.CR cs.AI cs.LGcited by 2

On the map: LLM safety and security → Audio jailbreaks and speech backdoors

Abstract (arXiv)

With the advances in deep learning, speaker verification has achieved very high accuracy and is gaining popularity as a type of biometric authentication option in many scenes of our daily life, especially the growing market of web services. Compared to traditional passwords, "vocal passwords" are much more convenient as they relieve people from memorizing different passwords. However, new machine learning attacks are putting these voice authentication systems at risk. Without a strong security guarantee, attackers could access legitimate users' web accounts by fooling the deep neural network (DNN) based voice recognition models. In this paper, we demonstrate an easy-to-implement data poisoning attack to the voice authentication system, which can hardly be captured by existing defense mechanisms. Thus, we propose a more robust defense method, called Guardian, which is a convolutional neural network-based discriminator. The Guardian discriminator integrates a series of novel techniques including bias reduction, input augmentation, and ensemble learning. Our approach is able to distinguish about 95% of attacked accounts from normal accounts, which is much more effective than existing approaches with only 60% accuracy.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Placed in Audio jailbreaks and speech backdoors, one of 12 directions in LLM safety and security. Builds on 35 of its 85 references that are in the map. First posted on arXiv 9 Sep 2022.

Builds on

35 of 85 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,336
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,379
  4. 2018VoxCeleb2: Deep Speaker Recognitioncited by 864
  5. 2017Ensemble Adversarial Training: Attacks and Defensescited by 839
  6. 2017VoxCeleb: a large-scale speaker identification datasetcited by 719
  7. 2017Generative Adversarial Networks: An Overviewcited by 589
  8. 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 517
  9. 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 456
  10. 2017Certified Defenses for Data Poisoning Attackscited by 302
  11. 2018Adversarial Attack on Graph Structured Datacited by 301
  12. 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 281
23 more
  1. 2017MagNet: a Two-Pronged Defense against Adversarial Examplescited by 269
  2. 2019Adversarial Attacks and Defenses in Images, Graphs and Text: A Reviewcited by 236
  3. 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 224
  4. 2018PRADA: Protecting against DNN Model Stealing Attackscited by 164
  5. 2018Stronger Data Poisoning Attacks Break Data Sanitization Defensescited by 133
  6. 2018Parametric Noise Injection: Trainable Randomness to Improve Deep Neural Network Robustness against Adversarial Attackcited by 124
  7. 2020Exploring wav2vec 2.0 on speaker verification and language identificationcited by 93
  8. 2019Prediction Poisoning: Towards Defenses Against DNN Model Stealing Attackscited by 80
  9. 2018Label Sanitization against Label Flipping Poisoning Attackscited by 72
  10. 2019Who is Real Bob? Adversarial Attacks on Speaker Recognition Systemscited by 67
  11. 2020Backdoor Attack against Speaker Verificationcited by 66
  12. 2020Speaker Recognition Based on Deep Learning: An Overviewcited by 59
  13. 2017Deep Speaker: an End-to-End Neural Speaker Embedding Systemcited by 57
  14. 2019Utterance-level Aggregation For Speaker Recognition In The Wildcited by 50
  15. 2015End-to-End Text-Dependent Speaker Verificationcited by 49
  16. 2018Detection of Adversarial Training Examples in Poisoning Attacks through Anomaly Detectioncited by 46
  17. 2020DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voicescited by 24
  18. 2021Attack on practical speaker verification system using universal adversarial perturbationscited by 18
  19. 2020AutoSpeech: Neural Architecture Search for Speaker Recognitioncited by 17
  20. 2020Voice-Indistinguishability: Protecting Voiceprint in Privacy-Preserving Speech Data Releasecited by 12
  21. 2016Curie: A method for protecting SVM Classifier from Poisoning Attackcited by 10
  22. 2021Understanding the Security of Deepfake Detectioncited by 6
  23. 2022Multi-Channel Man-in-the-Middle Attacks Against Protected Wi-Fi Networks: A State of the Art Reviewcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mitigating Backdoor Triggered and Targeted Data Poisoning Attacks in Voice Authentication Systems
  2. 2023Backdoor Attacks against Voice Recognition Systems: A Survey
  3. 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systems
  4. 2025VocalCrypt: Novel Active Defense Against Deepfake Voice Based on Masking Effect ↗
  5. 2023Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion
  6. 2022VSVC: Backdoor attack against Keyword Spotting based on Voiceprint Selection and Voice Conversion
  7. 2023FlowMur: A Stealthy and Practical Audio Backdoor Attack with Limited Knowledge
  8. 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Sound