Myovox: Reading Speech from the Muscles of the Face
Not on the map. Why?
Abstract (arXiv)
Myovox, from myo (muscle) and vox (voice), decodes open-vocabulary English text from 31-channel surface electromyography (sEMG) recorded from the muscles of the face during vocalized speech. It takes the single-subject emg2speech General Corpus from a published 51.17% word error rate to 18.53%, in three separable moves, each measured in isolation. First, I recover the open-vocabulary decode settings missing from the public release and reach a faithful 40.63% WER / 39.02% PER baseline whose phone error rate matches the published one to within 0.8 points, so the acoustic model is reproduced faithfully. Second, I replace the causal encoder with a bidirectional Conformer trained by a four-term cross-modal distillation against the parallel audio's WavLM-Large layer-9 features, reaching 26.14% WER / 22.34% PER from the electromyography alone. Third, I ensemble two acoustic models, union their multi-scale n-best lists, and rerank with a QLoRA-fine-tuned 7B language model, reaching 18.53% WER, the best result reported on this corpus, though not the best reported for sEMG-to-text on other corpora (Section 2). I then report the negative result that bounds the whole approach: reranking is exhausted at 18.5% because the binding constraint is the electromyographic acoustic phone error rate (~20.9%), not the language model. The correct words are simply absent from the acoustic posteriors, so no reranker can reach the 9.30% n-best oracle. All test numbers are on the 400-sentence held-out test set under the authors' official 8,500 / 760 / 400 sequential split; every hyperparameter is tuned once on validation and applied once to test.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
17 of 40 references.
References · 17
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Sequence-to-Sequence Speech Recognition with Time-Depth Separable Convolutionscited by 27
- 2020Digital Voicing of Silent Speechcited by 24
- 2025Brain-to-Text Decoding: A Non-invasive Approach via Typingcited by 22
- 2021An Improved Model for Voicing Silent Speechcited by 15
- 2024A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognitioncited by 9
- 2024Brain-to-Text Decoding with Context-Aware Neural Representations and Large Language Modelscited by 7
5 more
- 2025Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMscited by 6
- 2026Accurate Decoding of Natural Sentences from Non-Invasive Brain Recordingscited by 4
- 2025emg2speech: Synthesizing speech from electromyography using self-supervised speech modelscited by 3
- 2024Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyographycited by 1
- 2025Non-invasive electromyographic speech neuroprosthesis: a geometric perspectivecited by 1
Built on by
Not cited yet.