mlsanityData to 14 Oct 2026

Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond

arXiv 2609.27650 ↗First posted 23 Sep 2026cs.CL cs.HC cs.NEcited by 1

Not on the map. Why?

Abstract (arXiv)

Brain-to-language decoding translates neural activity associated with language production, internal speech and perception into linguistic or expressive outputs. It offers a route to restoring communication after speech loss and a means of studying how the brain represents language. Advances in neural recording and representation learning have expanded the field from constrained recognition and acoustic reconstruction to text generation, streaming personalised speech and facial animation. This survey synthesises these developments across invasive and non-invasive measurements, drawing on a search without a lower year limit and source-led updates through September 2026. We connect Articulated, Inner and Perceived tasks to the neural populations they engage, the representations available to decoders and the outputs those representations can support. We examine model development, public resources and the evolution of evaluation, and compare published performance and communication costs within their reported protocols. The synthesis identifies complementary routes to progress: phonetic, acoustic and semantic targets preserve different aspects of a message; shared representations support reuse across recording conditions and tasks; and online communication increasingly depends on calibration, feedback and user control alongside decoding accuracy. Shared benchmarks enable algorithmic comparisons, while longitudinal studies reveal the demands of sustained use. We discuss these developments and their remaining limitations, then outline a prospective five-level trajectory from commands and language to meaning, scenarios and bidirectional cognitive exchange

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 59 of its 495 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

59 of 495 references.

References · 59

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  2. 2025Mean Flows for One-step Generative Modelingcited by 561
  3. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  4. 2023Mousai: Text-to-Music Generation with Long-Context Latent Diffusioncited by 78
  5. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  6. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  7. 2025BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signalscited by 27
  8. 2023Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)cited by 21
  9. 2024EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classificationcited by 21
  10. 2024EEG2TEXT: Open Vocabulary EEG-to-Text Decoding with EEG Pre-Training and Multi-View Transformercited by 20
  11. 2025The 2025 PNPL Competition: Speech Detection and Phoneme Classification in the LibriBrain Datasetcited by 17
  12. 2024Brain Treebank: Large-scale intracranial recordings from naturalistic language stimulicited by 16
38 more
  1. 2025FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Modelcited by 16
  2. 2024MAD: Multi-Alignment MEG-to-Text Decodingcited by 15
  3. 2025Unlocking Non-Invasive Brain-to-Textcited by 15
  4. 2025Neural Codecs as Biosignal Tokenizerscited by 14
  5. 2024NeuSpeech: Decode Neural signal as Speechcited by 11
  6. 2024BELT-2: Bootstrapping EEG-to-Language representation alignment for multi-task brain decodingcited by 10
  7. 2024Brain-to-Text Benchmark '24: Lessons Learnedcited by 8
  8. 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 8
  9. 2024NeuGPT: Unified multi-modal Neural GPTcited by 7
  10. 2026MEG-XL: Data-Efficient Brain-to-Text via Long-Context Pre-Trainingcited by 7
  11. 2025Time-Masked Transformers with Lightweight Test-Time Adaptation for Neural Speech Decodingcited by 6
  12. 2025Learning Interpretable Representations Leads to Semantically Faithful EEG-to-Text Generationcited by 5
  13. 2026LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scalecited by 5
  14. 2025Pretraining Large Brain Language Model for Active BCI: Silent Speechcited by 4
  15. 2025EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEGcited by 4
  16. 2025On Creating A Brain-To-Text Decodercited by 3
  17. 2025BP-GPT: Auditory Neural Decoding Using fMRI-prompted LLMcited by 3
  18. 2025Bridging Brain Signals and Language: A Deep Learning Approach to EEG-to-Text Decodingcited by 3
  19. 2025ETS: Open Vocabulary Electroencephalography-To-Text Decoding and Sentiment Classificationcited by 3
  20. 2026Zero-Shot Imagined Speech Decoding via Imagined-to-Listened MEG Mappingcited by 3
  21. 2026What Are We Actually Decoding? Source Attribution for Non-Invasive Brain-to-Language Retrievalcited by 3
  22. 2026A Common Measure of Communication for Speech Brain-Computer Interfacescited by 3
  23. 2022Six-center Assessment of CNN-Transformer with Belief Matching Loss for Patient-independent Seizure Detection in EEGcited by 2
  24. 2024Improving Speech Decoding from ECoG with Self-Supervised Pretrainingcited by 2
  25. 2026SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrievalcited by 2
  26. 2026NeuroSonic: Conditional Flow Matching for EEG-to-Speech Reconstructioncited by 2
  27. 2026Cross-Subject Generalization in Decoding Perceived Speech from Non-Invasive Brain Recordingscited by 2
  28. 2026The 2026 PNPL Competition: Word Classification and Efficient Cross-Subject Generalisation in LibriBrain100cited by 2
  29. 2026The Semantic Bottleneck: Leveraging Semantic Representations for Non-Invasive Speech Decodingcited by 2
  30. 2024Comparison of linear and nonlinear methods for decoding selective attention to speech from ear-EEG recordingscited by 1
  31. 2024ArEEG_Chars: Dataset for Envisioned Speech Recognition using EEG for Arabic Characterscited by 1
  32. 2024MindSpeech: Continuous Imagined Speech Decoding using High-Density fNIRS and Prompt Tuning for Advanced Human-AI Interactioncited by 1
  33. 2024ArEEG_Words: Dataset for Envisioned Speech Recognition using EEG for Arabic Wordscited by 1
  34. 2025Cueless EEG imagined speech for subject identification: dataset and benchmarkscited by 1
  35. 2025EEG-to-Text Translation: A Model for Deciphering Human Brain Activitycited by 1
  36. 2025Neurocognitive Modeling for Text Generation: Deep Learning Architecture for EEG Datacited by 1
  37. 2025DELTA: Language Diffusion-based EEG-to-Text Architecturecited by 1
  38. 2026Wave2Word: A Multimodal Transformer Framework for Joint EEG-Text Alignment and Multi-Task Representation Learning in Neurocritical Carecited by 1

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.