mlsanityData to 7 Oct 2026

From Neurons to Conversation: Speech Brain-Computer Interfaces

arXiv 2609.36736 ↗First posted 29 Sep 2026cs.HC cs.CL q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Speech brain-computer interfaces (BCIs) aim to restore communication by transforming neural activity related to speech, language, or communicative intent into external outputs such as text, synthesized voice, or avatar control. Recent advances in intracortical and electrocorticographic recording, deep sequence models, and language-model-assisted decoding have enabled rapid progress, including high-performance attempted-speech decoding and increasingly naturalistic speech synthesis. Yet these achievements also reveal that speech BCIs are not simply neural-to-text decoders. They are adaptive clinical systems in which neural representations, recording hardware, decoding architectures, language priors, feedback, and user learning interact over time. Here, we synthesize speech BCI research from a system-level perspective. We first examine the neural substrates of speech and language, emphasizing their hierarchical, distributed, temporally structured, and non-stationary organization. We then examine recording and decoding choices, closed-loop adaptation, evaluation, clinical translation, and ethics. Across these domains, we highlight recurring trade-offs between signal resolution and invasiveness, low-level motor and high-level semantic targets, decoder accuracy and user agency, and language-model fluency and faithful neural evidence. We argue the next generation of speech BCIs should be evaluated not only by offline accuracy, but also by robustness across sessions, calibration burden, latency, uncertainty, usability, and safeguards against unintended decoding. By reframing speech BCIs as adaptive, user-centred systems, we outline the interdisciplinary priorities spanning speech neuroscience, neural engineering, machine learning, clinical practice, and neuroethics needed to move from proof-of-concept decoding toward reliable, expressive, and controllable communication neuroprostheses.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 162 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

23 of 162 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017On Calibration of Modern Neural Networkscited by 4,860
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  5. 2018Datasheets for Datasetscited by 1,371
  6. 2018Model Cards for Model Reportingcited by 1,068
  7. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  8. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  9. 2015Listen, Attend and Spellcited by 542
  10. 2022Decoding speech perception from non-invasive brain recordingscited by 129
  11. 2017Machine learning for neural decodingcited by 45
  12. 2016Making brain-machine interfaces robust to future neural variabilitycited by 23
11 more
  1. 2024The Brain's Bitter Lesson: Scaling Speech Decoding With Self-Supervised Learningcited by 21
  2. 2025Brain-to-Text Decoding: A Non-invasive Approach via Typingcited by 21
  3. 2025LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scalecited by 20
  4. 2024Evidence from fMRI Supports a Two-Phase Abstraction Process in Language Modelscited by 13
  5. 2025From Thought to Action: How a Hierarchy of Neural Dynamics Supports Language Productioncited by 9
  6. 2025Time-Masked Transformers with Lightweight Test-Time Adaptation for Neural Speech Decodingcited by 4
  7. 2025A cross-species neural foundation model for end-to-end speech decodingcited by 4
  8. 2025Emergence of Language in the Developing Braincited by 4
  9. 2025A Pre-trained Framework for Multilingual Brain Decoding Using Non-invasive Recordingscited by 1
  10. 2026Decoding the decoder: Contextual sequence-to-sequence modeling for intracortical speech decodingcited by 1
  11. 2026Temporal structure of the language hierarchy within small cortical patchescited by 1

Built on by

Not cited yet.