mlsanityData to 19 Oct 2026

Streaming Keyword Spotting Boosted by Cross-layer Discrimination Consistency

arXiv 2412.12635 ↗First posted 17 Dec 2024eess.AS cs.SDcited by 1

On the map: Speech and audio language models → Speech recognition models and training

Abstract (arXiv)

Connectionist Temporal Classification (CTC), a non-autoregressive training criterion, is widely used in online keyword spotting (KWS). However, existing CTC-based KWS decoding strategies either rely on Automatic Speech Recognition (ASR), which performs suboptimally due to its broad search over the acoustic space without keyword-specific optimization, or on KWS-specific decoding graphs, which are complex to implement and maintain. In this work, we propose a streaming decoding algorithm enhanced by Cross-layer Discrimination Consistency (CDC), tailored for CTC-based KWS. Specifically, we introduce a streamlined yet effective decoding algorithm capable of detecting the start of the keyword at any arbitrary position. Furthermore, we leverage discrimination consistency information across layers to better differentiate between positive and false alarm samples. Our experiments on both clean and noisy Hey Snips datasets show that the proposed streaming decoding strategy outperforms ASR-based and graph-based KWS baselines. The CDC-boosted decoding further improves performance, yielding an average absolute recall improvement of 6.8% and a 46.3% relative reduction in the miss rate compared to the graph-based KWS baseline, with a very low false alarm rate of 0.05 per hour.

Key facts. Cited by 1 paper in the map (data through 19 Oct 2026). Placed in Speech recognition models and training, one of 11 directions in Speech and audio language models. Builds on 20 of its 36 references that are in the map. First posted on arXiv 17 Dec 2024.

Builds on

20 of 36 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer20 Mar
  2. 2023U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias15 Dec
  3. 2021Hierarchical Conditional End-to-End ASR with CTC and Multi-Granular Subword Units8 Oct
  4. 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictions6 Apr
  5. 2021Intermediate Loss Regularization for CTC-based Speech Recognition5 Feb

Other references · 15

  1. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,636
  2. 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 246
  3. 2021Deep Spoken Keyword Spotting: An Overviewcited by 45
  4. 2018Deep-FSMN for Large Vocabulary Continuous Speech Recognitioncited by 39
  5. 2023Improving Massively Multilingual ASR With Auxiliary CTC Objectivescited by 34
  6. 2014First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNscited by 32
  7. 2018Efficient keyword spotting using dilated convolutions and gatingcited by 27
  8. 2018End-to-End Streaming Keyword Spottingcited by 27
  9. 2020Small-Footprint Open-Vocabulary Keyword Spotting with Quantized LSTM Networkscited by 11
  10. 2020Multi-Task Network for Noise-Robust Keyword Spotting and Speaker Verification using CTC-based Soft VAD and Global Query Attentioncited by 11
  11. 2021Wake Word Detection with Streaming Transformerscited by 11
  12. 2024Multilingual Audio-Visual Speech Recognition with Hybrid CTC/RNN-T Fast Conformercited by 10
3 more
  1. 2022WeKws: A production first small-footprint end-to-end Keyword Spotting Toolkitcited by 6
  2. 2024Contrastive Learning With Audio Discrimination For Customizable Keyword Spotting In Continuous Speechcited by 6
  3. 2024Text-aware Speech Separation for Multi-talker Keyword Spottingcited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Contextual Biasing for Streaming ASR via CTC-based Word Spotting
  2. 2025MFA-KWS: Effective Keyword Spotting with Multi-head Frame-asynchronous Decoding
  3. 2025WCTC-Biasing: Retraining-free Contextual Biasing ASR with Wildcard CTC-based Keyword Spotting and Inter-layer Biasing
  4. 2023DCCRN-KWS: an audio bias based model for noise robust small-footprint keyword spotting
  5. 2025Dual Data Scaling for Robust Two-Stage User-Defined Keyword Spotting
  6. 2021VAD-free Streaming Hybrid CTC/Attention ASR for Unsegmented Recording
  7. 2021Multi-task Learning with Cross Attention for Keyword Spotting
  8. 2025Masked Self-distilled Transducer-based Keyword Spotting with Semi-autoregressive Decoding ↗