mlsanityData to 14 Oct 2026

Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasound

arXiv 2306.16022 ↗First posted 28 Jun 2023cs.SD cs.CR eess.AScited by 5

On the map: LLM safety and security → Audio jailbreaks and speech backdoors

Abstract (arXiv)

Automatic Speaker Recognition Systems (SRSs) have been widely used in voice applications for personal identification and access control. A typical SRS consists of three stages, i.e., training, enrollment, and recognition. Previous work has revealed that SRSs can be bypassed by backdoor attacks at the training stage or by adversarial example attacks at the recognition stage. In this paper, we propose Tuner, a new type of backdoor attack against the enrollment stage of SRS via adversarial ultrasound modulation, which is inaudible, synchronization-free, content-independent, and black-box. Our key idea is to first inject the backdoor into the SRS with modulated ultrasound when a legitimate user initiates the enrollment, and afterward, the polluted SRS will grant access to both the legitimate user and the adversary with high confidence. Our attack faces a major challenge of unpredictable user articulation at the enrollment stage. To overcome this challenge, we generate the ultrasonic backdoor by augmenting the optimization process with random speech content, vocalizing time, and volume of the user. Furthermore, to achieve real-world robustness, we improve the ultrasonic signal over traditional methods using sparse frequency points, pre-compensation, and single-sideband (SSB) modulation. We extensively evaluate Tuner on two common datasets and seven representative SRS models, as well as its robustness against seven kinds of defenses. Results show that our attack can successfully bypass speaker recognition systems while remaining effective to various speakers, speech content, etc. To mitigate this newly discovered threat, we also provide discussions on potential countermeasures, limitations, and future works of this new threat.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Audio jailbreaks and speech backdoors, one of 12 directions in LLM safety and security. Builds on 34 of its 89 references that are in the map. First posted on arXiv 28 Jun 2023.

Builds on

34 of 89 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  3. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
  4. 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
  5. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
  6. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
  7. 2020Backdoor Learning: A Surveycited by 426
  8. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
  9. 2017Generalized End-to-End Loss for Speaker Verificationcited by 293
  10. 2018Audio Adversarial Examples: Targeted Attacks on Speech-to-Textcited by 274
  11. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 181
  12. 2021Rethinking the Backdoor Attacks' Triggers: A Frequency Perspectivecited by 161
22 more
  1. 2020In defence of metric learning for speaker recognitioncited by 126
  2. 2017DolphinAtack: Inaudible Voice Commandscited by 69
  3. 2019Who is Real Bob? Adversarial Attacks on Speaker Recognition Systemscited by 67
  4. 2018CommanderSong: A Systematic Approach for Practical Adversarial Voice Recognitioncited by 66
  5. 2020Backdoor Attack against Speaker Verificationcited by 66
  6. 2019Utterance-level Aggregation For Speaker Recognition In The Wildcited by 50
  7. 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 44
  8. 2019Hear "No Evil", See "Kenansville": Efficient and Transferable Black-Box Attacks on Speech Recognition and Voice Identification Systemscited by 38
  9. 2019Practical Hidden Voice Attacks against Speech and Speaker Recognition Systemscited by 36
  10. 2019SirenAttack: Generating Adversarial Audio for End-to-End Acoustic Systemscited by 34
  11. 2020Enabling Fast and Universal Audio Adversarial Attack Using Generative Modelcited by 32
  12. 2020A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differencescited by 23
  13. 2020Light Commands: Laser-Based Audio Injection Attacks on Voice-Controllable Systemscited by 18
  14. 2021Attack on practical speaker verification system using universal adversarial perturbationscited by 18
  15. 2022Improving speaker de-identification with functional data analysis of f0 trajectoriescited by 12
  16. 2020SpeakerNet: 1D Depth-wise Separable Convolutional Network for Text-Independent Speaker Recognition and Verificationcited by 11
  17. 2019Short-duration Speaker Verification (SdSV) Challenge 2021: the Challenge Evaluation Plancited by 9
  18. 2020Deep Speaker Embeddings for Far-Field Speaker Recognition on Short Utterancescited by 9
  19. 2020Cross-Lingual Speaker Verification with Domain-Balanced Hard Prototype Mining and Language-Dependent Score Normalizationcited by 5
  20. 2022GhostTalk: Interactive Attack on Smartphone Voice System Through Power Linecited by 5
  21. 2020When the Differences in Frequency Domain are Compensated: Understanding and Defeating Modulated Replay Attacks on Automatic Speech Recognitioncited by 4
  22. 2020When Automatic Voice Disguise Meets Automatic Speaker Verificationcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Target Backdoor Attacks Against Speaker Recognition
  2. 2023FlowMur: A Stealthy and Practical Audio Backdoor Attack with Limited Knowledge
  3. 2023Backdoor Attacks against Voice Recognition Systems: A Survey
  4. 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Sound
  5. 2026Backdooring Acoustic Foundation Models for Physically Realizable Triggers
  6. 2026SpeechGuard: Online Defense against Backdoor Attacks on Speech Recognition Models
  7. 2023Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion
  8. 2026Ouroboros: Self-Referential Backdoor Attacks on Speech Enhancement via Clean Audio Triggers