mlsanityData to 14 Oct 2026

Digital Voicing of Silent Speech

arXiv 2010.02960 ↗First posted 6 Oct 2020eess.AS cs.CL cs.LGcited by 24

Not on the map. Why?

Abstract (arXiv)

In this paper, we consider the task of digitally voicing silent speech, where silently mouthed words are converted to audible speech based on electromyography (EMG) sensor measurements that capture muscle impulses. While prior work has focused on training speech synthesis models from EMG collected during vocalized speech, we are the first to train from EMG collected during silently articulated speech. We introduce a method of training on silent EMG by transferring audio targets from vocalized to silent signals. Our method greatly improves intelligibility of audio generated from silent EMG compared to a baseline that only trains with vocalized data, decreasing transcription word error rate from 64% to 4% in one data condition and 88% to 68% in another. To spur further development on this task, we share our new dataset of silent and vocalized facial EMG measurements.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 4; 2025: 10; 2026: 7.

24 papers.

Sort:

By area:

  1. 2021An Improved Model for Voicing Silent Speechcited by 15
  2. 2024Twins-PainViT: Towards a Modality-Agnostic Vision Transformer Framework for Multimodal Automatic Pain Assessment using Facial Videos and fNIRScited by 14
  3. 2025PainFormer: a Vision Foundation Model for Automatic Pain Assessmentcited by 10
  4. 2024A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognitioncited by 9
  5. 2022ASHA: Assistive Teleoperation via Human-in-the-Loop Reinforcement Learningcited by 8
  6. 2025Tiny-BioMoE: a Lightweight Embedding Model for Biosignal Analysiscited by 8
  7. 2025TinyMyo: a Tiny Foundation Model for Flexible EMG Signal Processing at the Edgecited by 7
  8. 2025Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMscited by 6
  9. 2024Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversioncited by 4
  10. 2025Decoding EEG Speech Perception with Transformers and VAE-based Data Augmentationcited by 4
  11. 2025Articulatory Feature Prediction from Surface EMG during Speech Productioncited by 4
  12. 2025emg2speech: Synthesizing speech from electromyography using self-supervised speech modelscited by 3
12 more
  1. 2025Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decodingcited by 2
  2. 2022EPG2S: Speech Generation and Speech Enhancement based on Electropalatography and Audio Signals using Multimodal Learningcited by 1
  3. 2024Geometry of orofacial neuromuscular signals: speech articulation decoding using surface electromyographycited by 1
  4. 2026Affect Decoding in Phonated and Silent Speech Production from Surface EMGcited by 1
  5. 2026Comparison of sEMG Encoding Accuracy Across Speech Modes Using Articulatory and Phoneme Featurescited by 1
  6. 2025A Silent Speech Decoding System from EEG and EMG with Heterogenous Electrode Configurationscited by 0
  7. 2025Reconstructing Unseen Sentences from Speech-related Biosignals for Open-vocabulary Neural Communicationcited by 0
  8. 2026Cross-Modal Masking for Robust Silent Speech Synthesis Using sEMG and Lipreadingcited by 0
  9. 2026SoniSpeech: A Large-Scale Open-Vocabulary Tri-Modal Dataset for Wearable Silent Speech Interfacescited by 0
  10. 2026Myovox: Reading Speech from the Muscles of the Facecited by 0
  11. 2026Multi-Subject Pretraining Enables Short-Calibration Personalization for Closed-Corpus Surface EMG Speech Decodingcited by 0
  12. 2026MyoCodec: A Streaming Neural Codec for Electromyographycited by 0