mlsanityData to 7 Oct 2026

Streaming keyword spotting on mobile devices

arXiv 2005.06720 ↗First posted 14 May 2020eess.AS cs.SDcited by 47

Not on the map. Why?

Abstract (arXiv)

In this work we explore the latency and accuracy of keyword spotting (KWS) models in streaming and non-streaming modes on mobile phones. NN model conversion from non-streaming mode (model receives the whole input sequence and then returns the classification result) to streaming mode (model receives portion of the input sequence and classifies it incrementally) may require manual model rewriting. We address this by designing a Tensorflow/Keras based library which allows automatic conversion of non-streaming models to streaming ones with minimum effort. With this library we benchmark multiple KWS models in both streaming and non-streaming modes on mobile phones and demonstrate different tradeoffs between latency and accuracy. We also explore novel KWS models with multi-head attention which reduce the classification error over the state-of-art by 10% on Google speech commands data sets V2. The streaming library with all experiments is open-sourced.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 9; 2023: 8; 2024: 8; 2025: 6; 2026: 4.

47 papers.

Sort:

By area:

  1. 2021AST: Audio Spectrogram Transformercited by 634
  2. 2021Keyword Transformer: A Self-Attention Model for Keyword Spottingcited by 59
  3. 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 47
  4. 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
  5. 2021Learning Efficient Representations for Keyword Spotting with Triplet Losscited by 24
  6. 2024StreamVC: Real-Time Low-Latency Voice Conversioncited by 15
  7. 2023The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any languagecited by 14
  8. 2021Temporal Knowledge Distillation for On-device Audio Classificationcited by 13
  9. 2021Teaching keyword spotters to spot new keywords with limited examplescited by 9
  10. 2023Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systemscited by 9
  11. 2022Personalized Keyword Spotting through Multi-task Learningcited by 7
  12. 2024Self-Learning for Personalized Keyword Spotting on Ultra-Low-Power Audio Sensorscited by 7
35 more
  1. 2022Streamable Neural Audio Synthesis With Non-Causal Convolutionscited by 6
  2. 2025EgoTrigger: Toward Audio-Driven Image Capture for Human Memory Enhancement in All-Day Energy-Efficient Smart Glassescited by 6
  3. 2021A Streamwise GAN Vocoder for Wideband Speech Coding at Very Low Bit Ratecited by 5
  4. 2021Tiny-CRNN: Streaming Wakeword Detection In A Low Footprint Settingcited by 5
  5. 2021Audiomer: A Convolutional Transformer For Keyword Spottingcited by 4
  6. 2022Avoid Overfitting User Specific Information in Federated Keyword Spottingcited by 4
  7. 2022LiCo-Net: Linearized Convolution Network for Hardware-efficient Keyword Spottingcited by 4
  8. 2022BiFSMNv2: Pushing Binary Neural Networks for Keyword Spotting to Real-Network Performancecited by 4
  9. 2025SpectroStream: A Versatile Neural Codec for General Audiocited by 4
  10. 2022TB or not TB? Acoustic cough analysis for tuberculosis classificationcited by 3
  11. 2025Chameleon: A Multiplier-Free Temporal Convolutional Network Accelerator for End-to-End Few-Shot and Continual Learning from Sequential Datacited by 3
  12. 2021Encoder-Decoder Neural Architecture Optimization for Keyword Spottingcited by 2
  13. 2021Attention-Free Keyword Spottingcited by 2
  14. 2023To Wake-up or Not to Wake-up: Reducing Keyword False Alarm by Successive Refinementcited by 2
  15. 2024Synth4Kws: Synthesized Speech for User Defined Keyword Spotting in Low Resource Environmentscited by 2
  16. 2024GE2E-KWS: Generalized End-to-End Training and Evaluation for Zero-shot Keyword Spottingcited by 2
  17. 2022I see what you hear: a vision-inspired method to localize wordscited by 1
  18. 2023Guided Speech Enhancement Networkcited by 1
  19. 2024Binaural Angular Separation Networkcited by 1
  20. 2024Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spottingcited by 1
  21. 2025Designing Neural Synthesizers for Low-Latency Interactioncited by 1
  22. 2026Segment Length Matters: A Study of Segment Lengths on Audio Fingerprinting Performancecited by 1
  23. 2022A Fast Network Exploration Strategy to Profile Low Energy Consumption for Keyword Spottingcited by 0
  24. 2022A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruningcited by 0
  25. 2023Semi-Supervised Federated Learning for Keyword Spottingcited by 0
  26. 2023MONDEO: Multistage Botnet Detectioncited by 0
  27. 2023Bidirectional Reactive Programming for Machine Learningcited by 0
  28. 2023Deformable Audio Transformer for Audio Event Detectioncited by 0
  29. 2024Enhancing User Experience in On-Device Machine Learning with Gated Compression Layerscited by 0
  30. 2024GhostRNN: Reducing State Redundancy in RNN with Cheap Operationscited by 0
  31. 2025Vocal Tract Length Warped Features for Spoken Keyword Spottingcited by 0
  32. 2025Keyword Mamba: Spoken Keyword Spotting with State Space Modelscited by 0
  33. 2026PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spottingcited by 0
  34. 2026Cumsum-Composable Phase Transport for Low-Cost Streaming Keyword Spottingcited by 0
  35. 2026Relaxed activation analysis of dataflow networks - A clock calculus for machine learning and real-time schedulingcited by 0