NeuroNarrator: A Generalist EEG-to-Text Foundation Model for Clinical Interpretation via Spectro-Spatial Grounding and Temporal State-Space Reasoning
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Electroencephalography (EEG) provides a non-invasive window into neural dynamics at high temporal resolution and plays a pivotal role in clinical neuroscience research. Despite this potential, prevailing computational approaches to EEG analysis remain largely confined to task-specific classification objectives or coarse-grained pattern recognition, offering limited support for clinically meaningful interpretation. To address these limitations, we introduce NeuroNarrator, the first generalist EEG-to-text foundation model designed to translate electrophysiological segments into precise clinical narratives. A cornerstone of this framework is the curation of NeuroCorpus-160K, the first harmonized large-scale resource pairing over 160,000 EEG segments with structured, clinically grounded natural-language descriptions. Our architecture first aligns temporal EEG waveforms with spatial topographic maps via a rigorous contrastive objective, establishing spectro-spatially grounded representations. Building on this grounding, we condition a Large Language Model through a state-space-inspired formulation that integrates historical temporal and spectral context to support coherent clinical narrative generation. This approach establishes a principled bridge between continuous signal dynamics and discrete clinical language, enabling interpretable narrative generation that facilitates expert interpretation and supports clinical reporting workflows. Extensive evaluations across diverse benchmarks and zero-shot transfer tasks highlight NeuroNarrator's capacity to integrate temporal, spectral, and spatial dynamics, positioning it as a foundational framework for time-frequency-aware, open-ended clinical interpretation of electrophysiological data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 28 of its 73 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
28 of 73 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2017Mixed Precision Trainingcited by 1,135
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
16 more
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 92
- 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 83
- 2018The Temple University Hospital Seizure Detection Corpuscited by 80
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 54
- 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 37
- 2023DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translationcited by 36
- 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 35
- 2018Improved EEG Event Classification Using Differential Energycited by 32
- 2021Self-supervised EEG Representation Learning for Automatic Sleep Stagingcited by 30
- 2019A review of feature extraction and performance evaluation in epileptic seizure detection using EEGcited by 29
- 2025EEG-CLIP : Learning EEG representations from natural language descriptionscited by 9
- 2024EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotypingcited by 6
- 2025EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEGcited by 3
- 2025NeuroLex: A Lightweight Domain Language Model for EEG Report Understanding and Generationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026What the LLM Should Not Say: Boundary-Aware Context Grounding for A Seven-Channel EEG Agent
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding
- 2025EEG-MedRAG: Enhancing EEG-based Clinical Decision-Making via Hierarchical Hypergraph Retrieval-Augmented Generation
- 2024EEG-GPT: Exploring Capabilities of Large Language Models for EEG Classification and Interpretation
- 2025WaveMind: Towards a Conversational EEG Foundation Model Aligned to Textual and Visual Modalities
- 2026SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrieval
- 2025A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond
- 2026NeuroGRIP: Retrieval-Augmented Graph Refinement for Knowledge-Grounded EEG Seizure Diagnosis