mlsanityData to 7 Oct 2026

Neuro-GPT: Towards A Foundation Model for EEG

arXiv 2311.03764 ↗First posted 7 Nov 2023cs.LG eess.SPcited by 69

Not on the map. Why?

Abstract (arXiv)

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of an EEG encoder and a GPT model. The foundation model is pre-trained on a large-scale data set using a self-supervised task that learns how to reconstruct masked EEG segments. We then fine-tune the model on a Motor Imagery Classification task to validate its performance in a low-data regime (9 subjects). Our experiments demonstrate that applying a foundation model can significantly improve classification performance compared to a model trained from scratch, which provides evidence for the generalizability of the foundation model and its ability to address challenges of data scarcity and heterogeneity in EEG. The code is publicly available at github.com/wenhui0206/NeuroGPT.

Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

10 of 25 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  4. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  5. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  6. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
  7. 2021Self-Supervised Pretraining Improves Self-Supervised Pretrainingcited by 81
  8. 2023A Unified, Scalable Framework for Neural Population Decodingcited by 59
  9. 2022Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Datacited by 39
  10. 2021EEG-Inception: An Accurate and Robust End-to-End Neural Network for EEG-based Motor Imagery Classificationcited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 29; 2026: 35.

69 papers.

Sort:

By area:

  1. 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 70
  2. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 46
  3. 2025EEG Foundation Models: A Critical Review of Current Progress and Future Directionscited by 30
  4. 2025Brain Foundation Models: A Survey on Advancements in Neural Signal Processing and Brain Discoverycited by 22
  5. 2024Neural decoding from stereotactic EEG: accounting for electrode variability across subjectscited by 17
  6. 2025FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Modelcited by 15
  7. 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 14
  8. 2025CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attentioncited by 13
  9. 2025Neural Codecs as Biosignal Tokenizerscited by 13
  10. 2025NeuroChat: A Neuroadaptive AI Chatbot for Customizing Learning Experiencescited by 11
  11. 2025A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectivescited by 10
  12. 2025LEAD: An EEG Foundation Model for Alzheimer's Disease Detectioncited by 8
38 more
  1. 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 7
  2. 2025ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Modelscited by 6
  3. 2026LLM as Clinical Graph Structure Refiner: Enhancing Representation Learning in EEG Seizure Diagnosiscited by 6
  4. 2026Let EEG Models Learn EEGcited by 6
  5. 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 5
  6. 2026NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfacescited by 5
  7. 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 5
  8. 2024Exploration of LLMs, EEG, and behavioral data to measure and support attention and sleepcited by 4
  9. 2024GEFM: Graph-Enhanced EEG Foundation Modelcited by 4
  10. 2025ManifoldFormer: Geometric Deep Learning for Neural Dynamics on Riemannian Manifoldscited by 4
  11. 2025A cross-species neural foundation model for end-to-end speech decodingcited by 4
  12. 2025DIVER-1: Scaling Intracranial EEG Foundation Models for Transferable Representationscited by 4
  13. 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applicationscited by 3
  14. 2025BioSerenity-E1: a self-supervised EEG model for medical applicationscited by 3
  15. 2026ZUNA: Flexible EEG Superresolution with Position-Aware Diffusion Autoencoderscited by 3
  16. 2026Bridging scalp and intracranial EEG in BCI via pretrained neural representations and geometric constraint embeddingcited by 3
  17. 2026What Do EEG Foundation Models Capture from Human Brain Signals?cited by 3
  18. 2024GPT2MEG: Quantizing MEG for Autoregressive Generationcited by 2
  19. 2026NeuroSkill(tm): Proactive Real-Time Agentic System Capable of Modeling Human State of Mindcited by 2
  20. 2026Channel Adaptation for EEG Foundation Models: A Systematic Benchmark Across Architectures, Tasks, and Training Regimescited by 2
  21. 2026EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Modelscited by 2
  22. 2025Advancing Brainwave Modeling with a Codebook-Based Foundation Modelcited by 1
  23. 2025Bridging Brain with Foundation Models through Self-Supervised Learningcited by 1
  24. 2025Grounding Intelligence in Movementcited by 1
  25. 2025BrainPro: Towards Large-scale Brain State-aware EEG Representation Learningcited by 1
  26. 2025STAMP: Spatial-Temporal Adapter with Multi-Head Poolingcited by 1
  27. 2026A Systematic Evaluation of Sample-Level Tokenization Strategies for MEG Foundation Modelscited by 1
  28. 2026CLEF: EEG Foundation Model for Learning Clinical Semanticscited by 1
  29. 2026Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Modelscited by 1
  30. 2026A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Modelscited by 1
  31. 2026Benchmarking Positional Encoding Strategies for Transformer-Based EEG Foundation Modelscited by 1
  32. 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysiscited by 1
  33. 2025CRIA: A Cross-View Interaction and Instance-Adapted Pre-training Framework for Generalizable EEG Representationscited by 0
  34. 2025On using AI for EEG-based BCI applications: problems, current challenges and future trendscited by 0
  35. 2025Introducing Multimodal Paradigm for Learning Sleep Staging PSG via General-Purpose Modelcited by 0
  36. 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
  37. 2025Generalist vs Specialist Time Series Foundation Models: Investigating Potential Emergent Behaviors in Assessing Human Health Using PPG Signalscited by 0
  38. 2025Beyond Hearing: Learning Task-Agnostic ExG Representations from Earphones via Physiology-Informed Tokenizationcited by 0

50 most cited of 69 All 69 (JSON)