A neural attention model for speech command recognition
Not on the map. Why?
Abstract (arXiv)
This paper introduces a convolutional recurrent network with attention for speech command recognition. Attention models are powerful tools to improve performance on natural language, image captioning and speech tasks. The proposed model establishes a new state-of-the-art accuracy of 94.1% on Google Speech Commands dataset V1 and 94.5% on V2 (for the 20-commands recognition task), while still keeping a small footprint of only 202K trainable parameters. Results are compared with previous convolutional implementations on 5 different tasks (20 commands recognition (V1 and V2), 12 commands recognition (V1), 35 word recognition (V1) and left-right (V1)). We show detailed performance results and demonstrate that the proposed attention mechanism not only improves performance but also allows inspecting what regions of the audio were taken into consideration by the network when outputting a given category.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 8; 2023: 6; 2024: 7; 2025: 3; 2026: 3.
44 papers.
Sort:
By area:
- 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networkscited by 113
- 2021Voice2Series: Reprogramming Acoustic Models for Time Series Classificationcited by 91
- 2021Keyword Transformer: A Self-Attention Model for Keyword Spottingcited by 59
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
- 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 47
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 41
- 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Soundcited by 28
- 2021Learning Efficient Representations for Keyword Spotting with Triplet Losscited by 24
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networkscited by 22
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlookcited by 20
- 2021Classical-to-Quantum Transfer Learning for Spoken Command Recognition Based on Quantum Neural Networkscited by 19
32 more
- 2022Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogrammingcited by 17
- 2021Temporal Knowledge Distillation for On-device Audio Classificationcited by 13
- 2023CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Losscited by 12
- 2024LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Unitscited by 11
- 2022Exploiting Low-Rank Tensor-Train Deep Neural Networks Based on Riemannian Gradient Descent With Illustrations of Speech Processingcited by 10
- 2021A Streaming End-to-End Framework For Spoken Language Understandingcited by 8
- 2021Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methodscited by 8
- 2022FedorAS: Federated Architecture Search under system heterogeneitycited by 4
- 2024Boosting keyword spotting through on-device learnable user speech characteristicscited by 4
- 2024A Backdoor Approach with Inverted Labels Using Dirty Label-Flipping Attackscited by 4
- 2021Neural Model Reprogramming with Similarity Based Mapping for Low-Resource Spoken Command Recognitioncited by 3
- 2022TB or not TB? Acoustic cough analysis for tuberculosis classificationcited by 3
- 2021Encoder-Decoder Neural Architecture Optimization for Keyword Spottingcited by 2
- 2021Attention-Free Keyword Spottingcited by 2
- 2023To Wake-up or Not to Wake-up: Reducing Keyword False Alarm by Successive Refinementcited by 2
- 2024Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importancecited by 2
- 2022Exploiting Hybrid Models of Tensor-Train Networks for Spoken Command Recognitioncited by 1
- 2022Speech Augmentation Based Unsupervised Learning for Keyword Spottingcited by 1
- 2023Keyword spotting -- Detecting commands in speech using deep learningcited by 1
- 2021Real-time low-resource phoneme recognition on edge devicescited by 0
- 2021End-to-end Keyword Spotting using Xception-1dcited by 0
- 2022Heterogeneous Reservoir Computing Models for Persian Speech Recognitioncited by 0
- 2022A Quantum Kernel Learning Approach to Acoustic Modeling for Spoken Command Recognitioncited by 0
- 2023Employing Hybrid Deep Neural Networks on Dari Speechcited by 0
- 2024NUTS, NARS, and Speechcited by 0
- 2024Language-Universal Speech Attributes Modeling for Zero-Shot Multilingual Spoken Keyword Recognitioncited by 0
- 2024Contrastive Augmentation: An Unsupervised Learning Approach for Keyword Spotting in Speech Technologycited by 0
- 2025Vocal Tract Length Warped Features for Spoken Keyword Spottingcited by 0
- 2025Speech Command Recognition Using LogNNet Reservoir Computing for Embedded Systemscited by 0
- 2026PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spottingcited by 0
- 2026SpeechGuard: Online Defense against Backdoor Attacks on Speech Recognition Modelscited by 0
- 2026Natural Backdoor Attacks on Speech Recognition Modelscited by 0
- 2026Natural Backdoor Attacks on Speech Recognition Models17 Jul 2026
- 2026SpeechGuard: Online Defense against Backdoor Attacks on Speech Recognition Models17 Jul 2026
- 2026PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spotting5 Mar 2026
- 2025Speech Command Recognition Using LogNNet Reservoir Computing for Embedded Systems31 Aug 2025
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook14 Mar 2025
- 2025Vocal Tract Length Warped Features for Spoken Keyword Spotting7 Jan 2025
- 2024Contrastive Augmentation: An Unsupervised Learning Approach for Keyword Spotting in Speech Technology31 Aug 2024
- 2024Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importance12 Aug 2024
- 2024Language-Universal Speech Attributes Modeling for Zero-Shot Multilingual Spoken Keyword Recognition4 Jun 2024
- 2024NUTS, NARS, and Speech28 May 2024
- 2024A Backdoor Approach with Inverted Labels Using Dirty Label-Flipping Attacks29 Mar 2024
- 2024Boosting keyword spotting through on-device learnable user speech characteristics12 Mar 2024
32 more
- 2024LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units20 Jan 2024
- 2023Keyword spotting -- Detecting commands in speech using deep learning9 Dec 2023
- 2023CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Loss26 Sep 2023
- 2023Towards Stealthy Backdoor Attacks against Speech Recognition via Elements of Sound17 Jul 2023
- 2023A Survey on Time-Series Pre-Trained Models18 May 2023
- 2023Employing Hybrid Deep Neural Networks on Dari Speech4 May 2023
- 2023To Wake-up or Not to Wake-up: Reducing Keyword False Alarm by Successive Refinement6 Apr 2023
- 2022Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogramming2 Nov 2022
- 2022A Quantum Kernel Learning Approach to Acoustic Modeling for Spoken Command Recognition2 Nov 2022
- 2022TB or not TB? Acoustic cough analysis for tuberculosis classification2 Sep 2022
- 2022FedorAS: Federated Architecture Search under system heterogeneity22 Jun 2022
- 2022Speech Augmentation Based Unsupervised Learning for Keyword Spotting28 May 2022
- 2022Heterogeneous Reservoir Computing Models for Persian Speech Recognition25 May 2022
- 2022Exploiting Low-Rank Tensor-Train Deep Neural Networks Based on Riemannian Gradient Descent With Illustrations of Speech Processing11 Mar 2022
- 2022Exploiting Hybrid Models of Tensor-Train Networks for Spoken Command Recognition11 Jan 2022
- 2021Deep Spoken Keyword Spotting: An Overview20 Nov 2021
- 2021Temporal Knowledge Distillation for On-device Audio Classification27 Oct 2021
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networks17 Oct 2021
- 2021Classical-to-Quantum Transfer Learning for Spoken Command Recognition Based on Quantum Neural Networks17 Oct 2021
- 2021Attention-Free Keyword Spotting14 Oct 2021
- 2021End-to-end Keyword Spotting using Xception-1d9 Oct 2021
- 2021Neural Model Reprogramming with Similarity Based Mapping for Low-Resource Spoken Command Recognition8 Oct 2021
- 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggers30 Jul 2021
- 2021Voice2Series: Reprogramming Acoustic Models for Time Series Classification17 Jun 2021
- 2021Broadcasted Residual Learning for Efficient Keyword Spotting8 Jun 2021
- 2021Encoder-Decoder Neural Architecture Optimization for Keyword Spotting4 Jun 2021
- 2021Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methods31 May 2021
- 2021A Streaming End-to-End Framework For Spoken Language Understanding20 May 2021
- 2021Keyword Transformer: A Self-Attention Model for Keyword Spotting1 Apr 2021
- 2021Real-time low-resource phoneme recognition on edge devices25 Mar 2021
- 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networks12 Mar 2021
- 2021Learning Efficient Representations for Keyword Spotting with Triplet Loss12 Jan 2021
- 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networkscited by 113
- 2021Voice2Series: Reprogramming Acoustic Models for Time Series Classificationcited by 91
- 2021Keyword Transformer: A Self-Attention Model for Keyword Spottingcited by 59
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
- 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 47
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 41
- 2021Learning Efficient Representations for Keyword Spotting with Triplet Losscited by 24
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networkscited by 22
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlookcited by 20
- 2021Classical-to-Quantum Transfer Learning for Spoken Command Recognition Based on Quantum Neural Networkscited by 19
- 2022Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogrammingcited by 17
12 most cited of 41 All 41 (JSON)
- 2026PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spotting5 Mar 2026
- 2025Speech Command Recognition Using LogNNet Reservoir Computing for Embedded Systems31 Aug 2025
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook14 Mar 2025
- 2025Vocal Tract Length Warped Features for Spoken Keyword Spotting7 Jan 2025
- 2024Contrastive Augmentation: An Unsupervised Learning Approach for Keyword Spotting in Speech Technology31 Aug 2024
- 2024Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importance12 Aug 2024
- 2024Language-Universal Speech Attributes Modeling for Zero-Shot Multilingual Spoken Keyword Recognition4 Jun 2024
- 2024NUTS, NARS, and Speech28 May 2024
- 2024A Backdoor Approach with Inverted Labels Using Dirty Label-Flipping Attacks29 Mar 2024
- 2024Boosting keyword spotting through on-device learnable user speech characteristics12 Mar 2024
- 2024LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units20 Jan 2024
- 2023Keyword spotting -- Detecting commands in speech using deep learning9 Dec 2023
12 newest of 41 All 41 (JSON)