mlsanityData to 14 Oct 2026

EMG-GPT: Predictive Pretraining on Residual-Quantized EMG Tokens for Hand Pose Estimation

arXiv 2610.05235 ↗First posted 4 Oct 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Surface electromyography (sEMG) is a low-power, cost-effective biosignal for hand-pose estimation and gesture classification. In this work, we examine whether self-supervised pretraining on sEMG can yield transferable representations for continuous hand-pose estimation. We introduce EMG-GPT, a causal transformer-based model that operates on discrete sEMG representations from a frozen residual vector quantization (RVQ) tokenizer and learns temporal dynamics through depth-autoregressive future-code prediction. The model combines within-frame integration with causal temporal modeling while preserving the geometry of the pretrained codebook. EMG-GPT shows competitive results in both Regression and Tracking tasks, supporting EMG-only pretraining as a viable approach for learning transferable sEMG representations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

12 of 18 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  3. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  4. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
  5. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  6. 2023Reconstructing Hands in 3D with Transformerscited by 306
  7. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
  8. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  9. 2024emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimationcited by 22
  10. 2025NeuroRVQ: Multi-Scale Biosignal Tokenization for Generative Foundation Modelscited by 6
  11. 2024BrainGPT: Unleashing the Potential of EEG Generalist Foundation Model by Autoregressive Pre-trainingcited by 4
  12. 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Muscle Bursts to Motor Intent: Self-Supervised Token Modeling for Heterogeneous EMG
  2. 2026Lightweight Test-Time Adaptation for EMG-Based Gesture Recognition
  3. 2026Leveraging Convolutional Sparse Autoencoders for Robust Movement Classification from Low-Density sEMG
  4. 2026EMGFlow: Robust and Efficient Surface Electromyography Synthesis via Flow Matching
  5. 2025SASG-DA: Sparse-Aware Semantic-Guided Diffusion Augmentation For Myoelectric Gesture Recognition
  6. 2026MyoFlow: Anchor-Tied Rectified Flow for HD-sEMG Gesture Recognition Across Sessions and Subjects
  7. 2024Online Adaptation for Myographic Control of Natural Dexterous Hand and Finger Movements
  8. 2021Memory-Efficient, Limb Position-Aware Hand Gesture Recognition using Hyperdimensional Computing