NasoVoce: A Nose-Mounted Low-Audibility Speech Interface for Always-Available Speech Interaction
Not on the map. Why?
Abstract (arXiv)
Silent and whispered speech offer promise for always-available voice interaction with AI, yet existing methods struggle to balance vocabulary size, wearability, silence, and noise robustness. We present NasoVoce, a nose-bridge-mounted interface that integrates a microphone and a vibration sensor. Positioned at the nasal pads of smart glasses, it unobtrusively captures both acoustic and vibration signals. The nasal bridge, close to the mouth, allows access to bone- and skin-conducted speech and enables reliable capture of low-volume utterances such as whispered speech. While the microphone captures high-quality audio, it is highly sensitive to environmental noise. Conversely, the vibration sensor is robust to noise but yields lower signal quality. By fusing these complementary inputs, NasoVoce generates high-quality speech robust against interference. Evaluation with Whisper Large-v2, PESQ, STOI, and MUSHRA ratings confirms improved recognition and quality. NasoVoce demonstrates the feasibility of a practical interface for always-available, continuous, and discreet AI voice conversations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 49 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
13 of 49 references.
References · 13
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2016Sequence-Level Knowledge Distillationcited by 761
- 2020DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancementcited by 133
- 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
- 2016LipNet: End-to-End Sentence-level Lipreadingcited by 79
- 2019Time-Domain Multi-modal Bone/air Conducted Speech Enhancementcited by 6
- 2023WESPER: Zero-shot and Realtime Whisper to Normal Voice Conversion for Whisper-based Speech Interactionscited by 6
- 2023LipLearner: Customizable Silent Speech Interactions on Mobile Devicescited by 5
- 2023SottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networkscited by 5
- 2024Leveraging Self-Supervised Models for Automatic Whispered Speech Recognitioncited by 2
1 more
Built on by
Not cited yet.