mlsanityData to 7 Oct 2026

End-to-End Intracortical Speech Decoding from Neural Activity

arXiv 2605.24313 ↗First posted 23 May 2026cs.CL cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Current high-performing intracortical speech neuroprostheses achieve low word error rates but typically rely on external language models during inference, increasing memory, computation, and latency. In this work, we investigate whether meaningful character-level decoding is achievable without such models. We propose an end-to-end Conformer-based neural decoder trained directly on intracortical recordings from a participant with amyotrophic lateral sclerosis (ALS). Without any external language model, the system achieves a character error rate (CER) of 23.80% on held-out validation data. Analysis shows that performance variability is driven by inter-session signal degradation, while dominant errors arise from incorrect word boundary segmentation. These results demonstrate that effective character-level decoding is possible in a fully end-to-end framework, providing a strong neural signal for downstream linguistic processing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 47 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

9 of 47 references.

References · 9

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  5. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  6. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  7. 2015Listen, Attend and Spellcited by 542
  8. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  9. 2019Jasper: An End-to-End Convolutional Neural Acoustic Modelcited by 75

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.