mlsanityData to 14 Oct 2026

MyoCodec: A Streaming Neural Codec for Electromyography

arXiv 2609.36687 ↗First posted 29 Sep 2026eess.SP cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural codecs encode continuous signals into compact sequences of discrete tokens, providing an interface for efficient transmission, storage, and token-based sequence modeling. This paradigm has been widely adopted in modern speech and audio frameworks; however, the biosignal domain still lacks a neural codec designed specifically for low-bitrate streaming and generalization across diverse downstream tasks. We present MyoCodec, a streaming neural codec designed for electromyography (EMG). Inspired by recent neural audio codecs, MyoCodec combines causal Transformers with residual vector quantization to encode continuous EMG signals into different levels of EMG representations spanning from continuous latent features to discrete tokens operating at 50 Hz. Trained on twelve public EMG datasets, MyoCodec achieves favorable performance in both intrinsic codec quality and representative downstream tasks, including typing (emg2qwerty), hand-pose (emg2pose), speech decoding (emg2speech), and speech-to-EMG synthesis (speech2emg). Across these tasks, MyoCodec exhibits strong performance against prior models while providing a compact and causal EMG representation. During streaming inference, it requires compute time of only 0.482 ms for each 20 ms frame, enabling real-time streaming. Also, the discrete token representation provided by MyoCodec has the potential to support integration into language-model based approaches, creating a path toward LLM-based interactive systems, where tokenized EMG representations are directly processed into such language or speech models. Code and model weights are released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

30 of 44 references.

References · 30

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  6. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  7. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  8. 2022High Fidelity Neural Audio Compressioncited by 687
  9. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  10. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  11. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
  12. 2018SDR - half-baked or well done?cited by 423
18 more
  1. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
  2. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  3. 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
  4. 2024TS3-Codec: Transformer-Based Simple Streaming Single Codeccited by 25
  5. 2020Digital Voicing of Silent Speechcited by 24
  6. 2024emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimationcited by 22
  7. 2024emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyographycited by 18
  8. 2021An Improved Model for Voicing Silent Speechcited by 15
  9. 2025Neural Codecs as Biosignal Tokenizerscited by 14
  10. 2022Open Access Dataset for Electromyography based Multi-code Biometric Authenticationcited by 12
  11. 2025TinyMyo: a Tiny Foundation Model for Flexible EMG Signal Processing at the Edgecited by 7
  12. 2019putEMG -- a surface electromyography hand gesture recognition datasetcited by 6
  13. 2025Articulatory Feature Prediction from Surface EMG during Speech Productioncited by 4
  14. 2025emg2speech: Synthesizing speech from electromyography using self-supervised speech modelscited by 3
  15. 2026An Approach to Simultaneous Acquisition of Real-Time MRI Video, EEG, and Surface EMG for Articulatory, Brain, and Muscle Activity During Speech Productioncited by 2
  16. 2026Reconstruct! Don't Encode: Self-Supervised Representation Reconstruction Loss for High-Intelligibility and Low-Latency Streaming Neural Audio Codeccited by 2
  17. 2026EMG-to-Speech with Fewer Channelscited by 1
  18. 2026Affect Decoding in Phonated and Silent Speech Production from Surface EMGcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Muscle Bursts to Motor Intent: Self-Supervised Token Modeling for Heterogeneous EMG
  2. 2026ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding
  3. 2025QINCODEC: Neural Audio Compression with Implicit Neural Codebooks
  4. 2026GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding
  5. 2025A High-Quality and Low-Complexity Streamable Neural Speech Codec with Knowledge Distillation
  6. 2026Leveraging Convolutional Sparse Autoencoders for Robust Movement Classification from Low-Density sEMG
  7. 2024Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversion
  8. 2025Generalizable, real-time neural decoding with hybrid state-space models