Neuro2Semantic: A Transfer Learning Framework for Semantic Reconstruction of Continuous Language from Human Intracranial EEG
Not on the map. Why?
Abstract (arXiv)
Decoding continuous language from neural signals remains a significant challenge in the intersection of neuroscience and artificial intelligence. We introduce Neuro2Semantic, a novel framework that reconstructs the semantic content of perceived speech from intracranial EEG (iEEG) recordings. Our approach consists of two phases: first, an LSTM-based adapter aligns neural signals with pre-trained text embeddings; second, a corrector module generates continuous, natural text directly from these aligned embeddings. This flexible method overcomes the limitations of previous decoding approaches and enables unconstrained text generation. Neuro2Semantic achieves strong performance with as little as 30 minutes of neural data, outperforming a recent state-of-the-art method in low-data settings. These results highlight the potential for practical applications in brain-computer interfaces and neural decoding technologies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 33 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
16 of 33 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022Generalized Decoding for Pixel, Image, and Languagecited by 294
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 192
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 66
- 2023DREAM: Visual Decoding from Reversing Human Visual Systemcited by 44
- 2024Contextual Feature Extraction Hierarchies Converge in Large Language Models and the Braincited by 32
- 2018Interpreting Encoding and Decoding Modelscited by 21
4 more
- 2024EEG2TEXT: Open Vocabulary EEG-to-Text Decoding with EEG Pre-Training and Multi-View Transformercited by 20
- 2024Toward Fully-End-to-End Listened Speech Decoding from EEG Signalscited by 8
- 2023Semantic reconstruction of continuous language from MEG signalscited by 5
- 2023Neural2Speech: A Transfer Learning Framework for Neural-Driven Speech Reconstructioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.