mlsanityData to 14 Oct 2026

Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversations

arXiv 2609.27037 ↗First posted 22 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Wake word detection is a critical component of virtual assistants, serving as the gateway to seamless user interactions. This paper introduces a novel wake-up system that extends traditional direct keyword detection with contextual trigger detection. After an initial wake word activation, the system uses reasoning to distinguish between user commands and unrelated speech, ensuring efficient and context-aware engagement. We present a data generation architecture that produces a 62.3-hour corpus of controllable multi-speaker conversations containing direct invocations, contextual follow-ups, and non-addressed speech. Experimental results demonstrate the effectiveness of the proposed approach across diverse synthetic conversational scenarios. We release the code, dataset and trained models to promote reproducibility and further advancements in intelligent assistant technologies.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 16 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

11 of 16 references.

References · 11

  1. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  2. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
  3. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  4. 2024Language Model Can Listen While Speakingcited by 63
  5. 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
  6. 2022Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systemscited by 28
  7. 2018End-to-End Streaming Keyword Spottingcited by 25
  8. 2020Few-Shot Keyword Spotting With Prototypical Networkscited by 18
  9. 2021Personalized Keyphrase Detection using Speaker and Environment Informationcited by 8
  10. 2020Howl: A Deployed, Open-Source Wake Word Detection Systemcited by 6
  11. 2026Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPOcited by 2

Built on by

Not cited yet.