Streaming Keyword Spotting Boosted by Cross-layer Discrimination Consistency
On the map: Speech and audio language models → Speech recognition models and training
Abstract (arXiv)
Connectionist Temporal Classification (CTC), a non-autoregressive training criterion, is widely used in online keyword spotting (KWS). However, existing CTC-based KWS decoding strategies either rely on Automatic Speech Recognition (ASR), which performs suboptimally due to its broad search over the acoustic space without keyword-specific optimization, or on KWS-specific decoding graphs, which are complex to implement and maintain. In this work, we propose a streaming decoding algorithm enhanced by Cross-layer Discrimination Consistency (CDC), tailored for CTC-based KWS. Specifically, we introduce a streamlined yet effective decoding algorithm capable of detecting the start of the keyword at any arbitrary position. Furthermore, we leverage discrimination consistency information across layers to better differentiate between positive and false alarm samples. Our experiments on both clean and noisy Hey Snips datasets show that the proposed streaming decoding strategy outperforms ASR-based and graph-based KWS baselines. The CDC-boosted decoding further improves performance, yielding an average absolute recall improvement of 6.8% and a 46.3% relative reduction in the miss rate compared to the graph-based KWS baseline, with a very low false alarm rate of 0.05 per hour.
Key facts. Cited by 1 paper in the map (data through 19 Oct 2026). Placed in Speech recognition models and training, one of 11 directions in Speech and audio language models. Builds on 20 of its 36 references that are in the map. First posted on arXiv 17 Dec 2024.
Builds on
20 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2024TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer20 Mar
- 2023U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias15 Dec
- 2021Hierarchical Conditional End-to-End ASR with CTC and Multi-Granular Subword Units8 Oct
- 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictions6 Apr
- 2021Intermediate Loss Regularization for CTC-based Speech Recognition5 Feb
Other references · 15
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,636
- 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 246
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 45
- 2018Deep-FSMN for Large Vocabulary Continuous Speech Recognitioncited by 39
- 2023Improving Massively Multilingual ASR With Auxiliary CTC Objectivescited by 34
- 2014First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNscited by 32
- 2018Efficient keyword spotting using dilated convolutions and gatingcited by 27
- 2018End-to-End Streaming Keyword Spottingcited by 27
- 2020Small-Footprint Open-Vocabulary Keyword Spotting with Quantized LSTM Networkscited by 11
- 2020Multi-Task Network for Noise-Robust Keyword Spotting and Speaker Verification using CTC-based Soft VAD and Global Query Attentioncited by 11
- 2021Wake Word Detection with Streaming Transformerscited by 11
- 2024Multilingual Audio-Visual Speech Recognition with Hybrid CTC/RNN-T Fast Conformercited by 10
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Contextual Biasing for Streaming ASR via CTC-based Word Spotting
- 2025MFA-KWS: Effective Keyword Spotting with Multi-head Frame-asynchronous Decoding
- 2025WCTC-Biasing: Retraining-free Contextual Biasing ASR with Wildcard CTC-based Keyword Spotting and Inter-layer Biasing
- 2023DCCRN-KWS: an audio bias based model for noise robust small-footprint keyword spotting
- 2025Dual Data Scaling for Robust Two-Stage User-Defined Keyword Spotting
- 2021VAD-free Streaming Hybrid CTC/Attention ASR for Unsegmented Recording
- 2021Multi-task Learning with Cross Attention for Keyword Spotting
- 2025Masked Self-distilled Transducer-based Keyword Spotting with Semi-autoregressive Decoding ↗