Deep Residual Learning for Small-Footprint Keyword Spotting
Not on the map. Why?
Abstract (arXiv)
We explore the application of deep residual learning and dilated convolutions to the keyword spotting task, using the recently-released Google Speech Commands Dataset as our benchmark. Our best residual network (ResNet) implementation significantly outperforms Google's previous convolutional neural networks in terms of accuracy. By varying model depth and width, we can achieve compact models that also outperform previous small-footprint variants. To our knowledge, we are the first to examine these approaches for keyword spotting, and our results establish an open-source state-of-the-art reference to support the development of future speech-based interfaces.
Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 20; 2023: 9; 2024: 9; 2025: 7; 2026: 6.
68 papers.
Sort:
By area:
- 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 48
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2021Few-Shot Keyword Spotting in Any Languagecited by 27
- 2021Query-by-Example Keyword Spotting system using Multi-head Attention and Softtriple Losscited by 25
- 2021Learning Efficient Representations for Keyword Spotting with Triplet Losscited by 24
- 2022Asymmetric Temperature Scaling Makes Larger Networks Teach Well Againcited by 23
- 2021PQK: Model Compression via Pruning, Quantization, and Knowledge Distillationcited by 21
- 2021Differentiable Network Pruning for Microcontrollerscited by 16
- 2021Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networkscited by 15
- 2023Matching Latent Encoding for Audio-Text based Keyword Spottingcited by 15
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaversecited by 14
- 2023The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any languagecited by 14
38 more
- 2021SubSpectral Normalization for Neural Audio Data Processingcited by 11
- 2023Flexible Keyword Spotting based on Homogeneous Audio-Text Embeddingcited by 10
- 2023Online Continual Learning in Keyword Spotting for Low-Resource Devices via Pooling High-Order Temporal Statisticscited by 9
- 2022Progressive Continual Learning for Spoken Keyword Spottingcited by 8
- 2022Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spottingcited by 8
- 2022DREAM: A Dynamic Scheduler for Dynamic Real-time Multi-model ML Workloadscited by 8
- 2023MoCA: Memory-Centric, Adaptive Execution for Multi-Tenant Deep Neural Networkscited by 8
- 2022Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spottingcited by 7
- 2022Personalized Keyword Spotting through Multi-task Learningcited by 7
- 2021Ultra-Low Power Keyword Spotting at the Edgecited by 6
- 2024TeMPO: Efficient Time-Multiplexed Dynamic Photonic Tensor Core for Edge AI with Compact Slow-Light Electro-Optic Modulatorcited by 6
- 2023PhantomSound: Black-Box, Query-Efficient Audio Adversarial Attack via Split-Second Phoneme Injectioncited by 5
- 2022Avoid Overfitting User Specific Information in Federated Keyword Spottingcited by 4
- 2022LiCo-Net: Linearized Convolution Network for Hardware-efficient Keyword Spottingcited by 4
- 2025AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spottingcited by 4
- 2021Text Anchor Based Metric Learning for Small-footprint Keyword Spottingcited by 3
- 2021EfficientWord-Net: An Open Source Hotword Detection Engine based on One-shot Learningcited by 3
- 2022Streaming Intended Query Detection using E2E Modeling for Continued Conversationcited by 3
- 2022HEiMDaL: Highly Efficient Method for Detection and Localization of wake-wordscited by 3
- 2022Filterbank Learning for Noise-Robust Small-Footprint Keyword Spottingcited by 3
- 2022Pex: Memory-efficient Microcontroller Deep Learning through Partial Executioncited by 3
- 2024Relational Proxy Loss for Audio-Text based Keyword Spottingcited by 3
- 2021Speech Enhancement for Wake-Up-Word detection in Voice Assistantscited by 2
- 2021Auto-KWS 2021 Challenge: Task, Datasets, and Baselinescited by 2
- 2021Encoder-Decoder Neural Architecture Optimization for Keyword Spottingcited by 2
- 2021Attention-Free Keyword Spottingcited by 2
- 2023To Wake-up or Not to Wake-up: Reducing Keyword False Alarm by Successive Refinementcited by 2
- 2024Text-Aware Adapter for Few-Shot Keyword Spottingcited by 2
- 2021Prototype-based Personalized Pruningcited by 1
- 2022Learning Decoupling Features Through Orthogonality Regularizationcited by 1
- 2022Improving Voice Trigger Detection with Metric Learningcited by 1
- 2022Speech Augmentation Based Unsupervised Learning for Keyword Spottingcited by 1
- 2022I see what you hear: a vision-inspired method to localize wordscited by 1
- 2023Robust Wake-Up Word Detection by Two-stage Multi-resolution Ensemblescited by 1
- 2024Sparse Binarization for Fast Keyword Spottingcited by 1
- 2024Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spottingcited by 1
- 2025Improving Pretrained YAMNet for Enhanced Speech Command Detection via Transfer Learningcited by 1
- 2025Adversarial Deep Metric Learning for Cross-Modal Audio-Text Alignment in Open-Vocabulary Keyword Spottingcited by 1
50 most cited of 68 All 68 (JSON)
- 2026Sub-Model Short-Term Memory Convolutions for Keyword Spotting Systems on Device28 Sep 2026
- 2026EdgeSpike: Spiking Neural Networks for Low-Power Autonomous Sensing in Edge IoT Architectures29 Apr 2026
- 2026PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spotting5 Mar 2026
- 2026OnDA: On-device Channel Pruning for Efficient Personalized Keyword Spotting25 Feb 2026
- 2026Domain-Incremental Continual Learning for Robust and Efficient Keyword Spotting in Resource Constrained Systems22 Jan 2026
- 2026MATE: Matryoshka Audio-Text Embeddings for Open-Vocabulary Keyword Spotting20 Jan 2026
- 2025Transformer Redesign for Late Fusion of Audio-Text Features on Ultra-Low-Power Edge Hardware20 Oct 2025
- 2025Keyword Spotting with Hyper-Matched Filters for Small Footprint Devices6 Aug 2025
- 2025PatchDSU: Uncertainty Modeling for Out of Distribution Generalization in Keyword Spotting5 Aug 2025
- 2025Enhancing Few-shot Keyword Spotting Performance through Pre-Trained Self-supervised Speech Models21 Jun 2025
- 2025Adversarial Deep Metric Learning for Cross-Modal Audio-Text Alignment in Open-Vocabulary Keyword Spotting22 May 2025
- 2025AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting17 May 2025
38 more
- 2025Improving Pretrained YAMNet for Enhanced Speech Command Detection via Transfer Learning26 Apr 2025
- 2024Text-Aware Adapter for Few-Shot Keyword Spotting24 Dec 2024
- 2024Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting23 Aug 2024
- 2024Explaining Spectrograms in Machine Learning: A Study on Neural Networks for Speech Classification10 Jul 2024
- 2024Multitaper mel-spectrograms for keyword spotting5 Jul 2024
- 2024On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks26 Jun 2024
- 2024Sparse Binarization for Fast Keyword Spotting9 Jun 2024
- 2024Relational Proxy Loss for Audio-Text based Keyword Spotting8 Jun 2024
- 2024RepCNN: Micro-sized, Mighty Models for Wakeword Detection4 Jun 2024
- 2024TeMPO: Efficient Time-Multiplexed Dynamic Photonic Tensor Core for Edge AI with Compact Slow-Light Electro-Optic Modulator12 Feb 2024
- 2023The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any language14 Nov 2023
- 2023Robust Wake-Up Word Detection by Two-stage Multi-resolution Ensembles17 Oct 2023
- 2023PhantomSound: Black-Box, Query-Efficient Audio Adversarial Attack via Split-Second Phoneme Injection13 Sep 2023
- 2023Flexible Keyword Spotting based on Homogeneous Audio-Text Embedding12 Aug 2023
- 2023Online Continual Learning in Keyword Spotting for Low-Resource Devices via Pooling High-Order Temporal Statistics24 Jul 2023
- 2023Matching Latent Encoding for Audio-Text based Keyword Spotting8 Jun 2023
- 2023MoCA: Memory-Centric, Adaptive Execution for Multi-Tenant Deep Neural Networks10 May 2023
- 2023To Wake-up or Not to Wake-up: Reducing Keyword False Alarm by Successive Refinement6 Apr 2023
- 2023Scalable Weight Reparametrization for Efficient Transfer Learning26 Feb 2023
- 2022DREAM: A Dynamic Scheduler for Dynamic Real-time Multi-model ML Workloads7 Dec 2022
- 2022Pex: Memory-efficient Microcontroller Deep Learning through Partial Execution30 Nov 2022
- 2022Filterbank Learning for Noise-Robust Small-Footprint Keyword Spotting19 Nov 2022
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaverse16 Nov 2022
- 2022LiCo-Net: Linearized Convolution Network for Hardware-efficient Keyword Spotting9 Nov 2022
- 2022HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words26 Oct 2022
- 2022I see what you hear: a vision-inspired method to localize words24 Oct 2022
- 2022Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again10 Oct 2022
- 2022Streaming Intended Query Detection using E2E Modeling for Continued Conversation29 Aug 2022
- 2022A Multi-tasking Model of Speaker-Keyword Classification for Keeping Human in the Loop of Drone-assisted Inspection8 Jul 2022
- 2022Personalized Keyword Spotting through Multi-task Learning28 Jun 2022
- 2022Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spotting28 Jun 2022
- 2022Avoid Overfitting User Specific Information in Federated Keyword Spotting17 Jun 2022
- 2022Frequency-centroid features for word recognition of non-native English speakers14 Jun 2022
- 2022Speech Augmentation Based Unsupervised Learning for Keyword Spotting28 May 2022
- 2022Improving Voice Trigger Detection with Metric Learning5 Apr 2022
- 2022Learning Decoupling Features Through Orthogonality Regularization31 Mar 2022
- 2022Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spotting30 Mar 2022
- 2022A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning17 Feb 2022
50 newest of 68 All 68 (JSON)
- 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 48
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2021Few-Shot Keyword Spotting in Any Languagecited by 27
- 2021Query-by-Example Keyword Spotting system using Multi-head Attention and Softtriple Losscited by 25
- 2021Learning Efficient Representations for Keyword Spotting with Triplet Losscited by 24
- 2021Differentiable Network Pruning for Microcontrollerscited by 16
- 2021Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networkscited by 15
- 2023Matching Latent Encoding for Audio-Text based Keyword Spottingcited by 15
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaversecited by 14
- 2023The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any languagecited by 14
- 2021SubSpectral Normalization for Neural Audio Data Processingcited by 11
- 2023Flexible Keyword Spotting based on Homogeneous Audio-Text Embeddingcited by 10
12 most cited of 66 All 66 (JSON)
- 2026Sub-Model Short-Term Memory Convolutions for Keyword Spotting Systems on Device28 Sep 2026
- 2026EdgeSpike: Spiking Neural Networks for Low-Power Autonomous Sensing in Edge IoT Architectures29 Apr 2026
- 2026PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spotting5 Mar 2026
- 2026OnDA: On-device Channel Pruning for Efficient Personalized Keyword Spotting25 Feb 2026
- 2026Domain-Incremental Continual Learning for Robust and Efficient Keyword Spotting in Resource Constrained Systems22 Jan 2026
- 2026MATE: Matryoshka Audio-Text Embeddings for Open-Vocabulary Keyword Spotting20 Jan 2026
- 2025Transformer Redesign for Late Fusion of Audio-Text Features on Ultra-Low-Power Edge Hardware20 Oct 2025
- 2025Keyword Spotting with Hyper-Matched Filters for Small Footprint Devices6 Aug 2025
- 2025PatchDSU: Uncertainty Modeling for Out of Distribution Generalization in Keyword Spotting5 Aug 2025
- 2025Enhancing Few-shot Keyword Spotting Performance through Pre-Trained Self-supervised Speech Models21 Jun 2025
- 2025Adversarial Deep Metric Learning for Cross-Modal Audio-Text Alignment in Open-Vocabulary Keyword Spotting22 May 2025
- 2025AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting17 May 2025
12 newest of 66 All 66 (JSON)