Sequential Randomized Smoothing for Adversarially Robust Speech Recognition
Not on the map. Why?
Abstract (arXiv)
While Automatic Speech Recognition has been shown to be vulnerable to adversarial attacks, defenses against these attacks are still lagging. Existing, naive defenses can be partially broken with an adaptive attack. In classification tasks, the Randomized Smoothing paradigm has been shown to be effective at defending models. However, it is difficult to apply this paradigm to ASR tasks, due to their complexity and the sequential nature of their outputs. Our paper overcomes some of these challenges by leveraging speech-specific tools like enhancement and ROVER voting to design an ASR model that is robust to perturbations. We apply adaptive versions of state-of-the-art attacks, such as the Imperceptible ASR attack, to our model, and show that our strongest defense is robust to all attacks that use inaudible noise, and can only be broken with very high distortion.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 5 Nov 2021.
Builds on
32 of 59 references.
References · 32
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,318
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
- 2020Fast is better than free: Revisiting adversarial trainingcited by 727
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 678
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 567
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 546
20 more
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 468
- 2018Defense-GAN: Protecting Classifiers Against Adversarial Attacks Using Generative Modelscited by 362
- 2018On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Modelscited by 328
- 2018Audio Adversarial Examples: Targeted Attacks on Speech-to-Textcited by 274
- 2019Adversarial Training and Robustness for Multiple Perturbationscited by 183
- 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 166
- 2017Towards Robust Neural Networks via Random Self-ensemblecited by 159
- 2019Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognitioncited by 124
- 2018Adversarial Attacks Against Automatic Speech Recognition Systems via Psychoacoustic Hidingcited by 85
- 2017DolphinAtack: Inaudible Voice Commandscited by 69
- 2018CommanderSong: A Systematic Approach for Practical Adversarial Voice Recognitioncited by 66
- 2017Mitigating Evasion Attacks to Deep Neural Networks via Region-based Classificationcited by 56
- 2018Robust Audio Adversarial Example for a Physical Attackcited by 44
- 2019Hear "No Evil", See "Kenansville": Efficient and Transferable Black-Box Attacks on Speech Recognition and Voice Identification Systemscited by 38
- 2018Characterizing Audio Adversarial Examples Using Temporal Dependencycited by 36
- 2019Espresso: A Fast End-to-end Neural Speech Recognition Toolkitcited by 31
- 2019Adversarial Music: Real World Audio Adversary Against Wake-word Detection Systemcited by 20
- 2021Adversarial Attacks and Defenses for Speech Recognition Systemscited by 20
- 2019Perceptual Based Adversarial Audio Attackscited by 13
- 2018Training Augmentation with Adversarial Examples for Robust Speech Recognitioncited by 11
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 1; 2025: 1; 2026: 6.
13 papers.
Sort:
By area:
- 2022Recent improvements of ASR models in the face of adversarial attackscited by 13
- 2022There is more than one kind of robustness: Fooling Whisper with adversarial examplescited by 11
- 2024Certification of Speaker Recognition Models to Additive Perturbationscited by 6
- 2022Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition modelscited by 2
- 2026Evaluating randomized smoothing as a defense against adversarial attacks in trajectory predictioncited by 1
- 2026Codec-Robust Attacks on Audio LLMscited by 1
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothingcited by 0
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformerscited by 0
- 2025Are Deep Speech Denoising Models Robust to Adversarial Noise?cited by 0
- 2026Representation Matters in Randomized Smoothing for Audio Classificationcited by 0
- 2026Beyond Waveform Robustness: Robust Feature-Vocoder Adversarial Attacks on Automatic Speech Recognitioncited by 0
- 2026What Was That Again? Certified Robustness for Automatic Speech Recognitioncited by 0
- 2026Psychoacoustically Aligned Latent Smoothing for Adversarial Robustness of Full-Duplex Speech-to-Speech Dialogue Models23 Sep 2026
- 2026What Was That Again? Certified Robustness for Automatic Speech Recognition26 Jun 2026
- 2026Beyond Waveform Robustness: Robust Feature-Vocoder Adversarial Attacks on Automatic Speech Recognition4 Jun 2026
- 2026Representation Matters in Randomized Smoothing for Audio Classification2 Jun 2026
- 2026Codec-Robust Attacks on Audio LLMs19 May 2026
- 2026Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction11 Mar 2026
- 2025Are Deep Speech Denoising Models Robust to Adversarial Noise?14 Mar 2025
- 2024Certification of Speaker Recognition Models to Additive Perturbations29 Apr 2024
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformers28 Nov 2023
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothing17 Aug 2023
- 2022There is more than one kind of robustness: Fooling Whisper with adversarial examples26 Oct 2022
- 2022Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition models17 Sep 2022
1 more
- 2022Recent improvements of ASR models in the face of adversarial attackscited by 13
- 2022There is more than one kind of robustness: Fooling Whisper with adversarial examplescited by 11
- 2024Certification of Speaker Recognition Models to Additive Perturbationscited by 6
- 2022Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition modelscited by 2
- 2026Evaluating randomized smoothing as a defense against adversarial attacks in trajectory predictioncited by 1
- 2026Codec-Robust Attacks on Audio LLMscited by 1
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothingcited by 0
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformerscited by 0
- 2025Are Deep Speech Denoising Models Robust to Adversarial Noise?cited by 0
- 2026Representation Matters in Randomized Smoothing for Audio Classificationcited by 0
- 2026Beyond Waveform Robustness: Robust Feature-Vocoder Adversarial Attacks on Automatic Speech Recognitioncited by 0
- 2026What Was That Again? Certified Robustness for Automatic Speech Recognitioncited by 0
- 2026What Was That Again? Certified Robustness for Automatic Speech Recognition26 Jun 2026
- 2026Beyond Waveform Robustness: Robust Feature-Vocoder Adversarial Attacks on Automatic Speech Recognition4 Jun 2026
- 2026Representation Matters in Randomized Smoothing for Audio Classification2 Jun 2026
- 2026Codec-Robust Attacks on Audio LLMs19 May 2026
- 2026Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction11 Mar 2026
- 2025Are Deep Speech Denoising Models Robust to Adversarial Noise?14 Mar 2025
- 2024Certification of Speaker Recognition Models to Additive Perturbations29 Apr 2024
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformers28 Nov 2023
- 2023General Lipschitz: Certified Robustness Against Resolvable Semantic Transformations via Transformation-Dependent Randomized Smoothing17 Aug 2023
- 2022There is more than one kind of robustness: Fooling Whisper with adversarial examples26 Oct 2022
- 2022Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition models17 Sep 2022
- 2022Recent improvements of ASR models in the face of adversarial attacks29 Mar 2022