mlsanityData to 7 Oct 2026

Backdoor Attacks on Speech Emotion Recognition via TTS-Generated Poisoning

arXiv 2606.21052 ↗First posted 19 Jun 2026cs.SD cs.AI cs.CRcited by 0

On the map: LLM safety and security → Audio jailbreaks and speech backdoors

Abstract (arXiv)

Speech Emotion Recognition (SER) systems increasingly leverage self-supervised acoustic representations, yet their vulnerability to training-time attacks remains largely underexplored. This paper presents the first systematic study of poisoning-based backdoor attacks on SER, with a focus on threats enabled by text-to-speech (TTS) generated audio. We introduce a stealthy, low-energy acoustic trigger that can be embedded imperceptibly into both natural and synthetic speech, enabling scalable and consistent poisoning. Our experiments demonstrate that SER models can be reliably compromised with high attack success rates under low poisoning ratios, while maintaining near-clean performance on benign inputs. We further show that backdoor patterns exhibit strong cross-model transferability and that self-supervised representations are particularly susceptible to learning these triggers. These findings reveal that TTS technology dramatically lowers the barrier to effective backdoor attacks, exposing critical vulnerabilities in modern SER pipelines and motivating the urgent need for dedicated defenses.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio jailbreaks and speech backdoors, one of 12 directions in LLM safety and security. Builds on 11 of its 32 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

11 of 32 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognition16 Jun
  2. 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Sound17 Jul
  3. 2023Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion28 Jun

Other references · 8

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  3. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  4. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
  5. 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 43
  6. 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 41
  7. 2024EmoBack: Backdoor Attacks Against Speaker Identification Using Emotional Prosodycited by 4
  8. 2024A Systematic Evaluation of Adversarial Attacks against Speech Emotion Recognition Modelscited by 1

Built on by

Not cited yet.