Personalized Keyphrase Detection using Speaker and Environment Information
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a streaming keyphrase detection system that can be easily customized to accurately detect any phrase composed of words from a large vocabulary. The system is implemented with an end-to-end trained automatic speech recognition (ASR) model and a text-independent speaker verification model. To address the challenge of detecting these keyphrases under various noisy conditions, a speaker separation model is added to the feature frontend of the speaker verification model, and an adaptive noise cancellation (ANC) algorithm is included to exploit cross-microphone noise coherence. Our experiments show that the text-independent speaker verification model largely reduces the false triggering rate of the keyphrase detection, while the speaker separation model and adaptive noise cancellation largely reduce false rejections.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 28 Apr 2021.
Builds on
22 of 40 references.
References · 22
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2017To prune, or not to prune: exploring the efficacy of pruning for model compressioncited by 596
- 2015LSTM: A Search Space Odysseycited by 315
- 2017Generalized End-to-End Loss for Speaker Verificationcited by 290
- 2018Streaming End-to-end Speech Recognition For Mobile Devicescited by 230
- 2015Deep clustering: Discriminative embeddings for segmentation and separationcited by 211
- 2020A Streaming On-Device End-to-End Model Surpassing Server-Side Conventional Model Quality and Latencycited by 99
- 2017Multi-talker Speech Separation with Utterance-level Permutation Invariant Training of Deep Recurrent Neural Networkscited by 97
- 2019Recognizing long-form speech using streaming end-to-end modelscited by 77
- 2018VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Maskingcited by 72
10 more
- 2019CN-CELEB: a challenging Chinese speaker recognition datasetcited by 47
- 2020Voice Separation with an Unknown Number of Multiple Speakerscited by 46
- 2019Optimizing Speech Recognition For The Edgecited by 32
- 2020VoiceFilter-Lite: Streaming Targeted Voice Separation for On-Device Speech Recognitioncited by 29
- 2018End-to-End Streaming Keyword Spottingcited by 25
- 2017Streaming Small-Footprint Keyword Spotting using Sequence-to-Sequence Modelscited by 19
- 2018Attention-based End-to-End Models for Small-Footprint Keyword Spottingcited by 18
- 2021Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognitioncited by 10
- 2020Version Control of Speaker Recognition Systemscited by 6
- 2015Deep Karaoke: Extracting Vocals from Musical Mixtures Using a Convolutional Deep Neural Networkcited by 5
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 1; 2024: 0; 2025: 1; 2026: 1.
8 papers.
- 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
- 2021Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detectioncited by 31
- 2023E3 TTS: Easy End-to-End Diffusion-based Text to Speechcited by 30
- 2021Multi-user VoiceFilter-Lite via Attentive Speaker Embeddingcited by 4
- 2022Closing the Gap between Single-User and Multi-User VoiceFilter-Litecited by 1
- 2022Improving Voice Trigger Detection with Metric Learningcited by 1
- 2025Keyword Spotting with Hyper-Matched Filters for Small Footprint Devicescited by 0
- 2026Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversationscited by 0
- 2026Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversations22 Sep 2026
- 2025Keyword Spotting with Hyper-Matched Filters for Small Footprint Devices6 Aug 2025
- 2023E3 TTS: Easy End-to-End Diffusion-based Text to Speech2 Nov 2023
- 2022Improving Voice Trigger Detection with Metric Learning5 Apr 2022
- 2022Closing the Gap between Single-User and Multi-User VoiceFilter-Lite24 Feb 2022
- 2021Deep Spoken Keyword Spotting: An Overview20 Nov 2021
- 2021Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detection23 Sep 2021
- 2021Multi-user VoiceFilter-Lite via Attentive Speaker Embedding2 Jul 2021