mlsanityData to 14 Oct 2026

EEG Foundation Models: A Critical Review of Current Progress and Future Directions

arXiv 2507.11783 ↗First posted 15 Jul 2025eess.SP cs.AI cs.LGcited by 32

Not on the map. Why?

Abstract (arXiv)

Premise. Patterns of electrical brain activity recorded via electroencephalography (EEG) offer immense value for scientific and clinical investigations. The inability of supervised EEG encoders to learn robust EEG patterns and their over-reliance on expensive signal annotations have sparked a transition towards general-purpose self-supervised EEG encoders, i.e., EEG foundation models (EEG-FMs), for robust and scalable EEG feature extraction. However, the real-world readiness of early EEG-FMs and the rubrics for long-term research progress remain unclear. Objective. In this work, we conduct a review of ten early EEG-FMs to capture common trends and identify key directions for future development of EEG-FMs. Methods. We comparatively analyze each EEG-FM using three fundamental pillars of foundation modeling, namely the representation of input data, self-supervised modeling, and the evaluation strategy. Based on this analysis, we present a critical synthesis of EEG-FM methodology, empirical findings, and outstanding research gaps. Results. We find that most EEG-FMs adopt a sequence-based modeling scheme that relies on transformer-based backbones and the reconstruction of masked temporal EEG sequences for self-supervision. However, model evaluations remain heterogeneous and largely limited, making it challenging to assess their practical off-the-shelf utility. In addition to adopting standardized and realistic evaluations, future work should demonstrate more substantial scaling effects and make principled and trustworthy choices throughout the EEG representation learning pipeline. Significance. Our review indicates that the development of benchmarks, software tools, technical methodologies, and applications in collaboration with domain experts may advance the translational utility and real-world adoption of EEG-FMs.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 71 of its 178 references that are in the map. First posted on arXiv 15 Jul 2025.

Builds on

71 of 178 references.

References · 71

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  8. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  9. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  10. 2023Segment Anythingcited by 8,234
  11. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  12. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
38 more
  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2022A ConvNet for the 2020scited by 3,579
  8. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  9. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  10. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  11. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  12. 2018Model Cards for Model Reportingcited by 1,080
  13. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  14. 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
  15. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
  16. 2021Florence: A New Foundation Model for Computer Visioncited by 804
  17. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  18. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
  19. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  20. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 548
  21. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  22. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  23. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  24. 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 303
  25. 2019Intrinsic dimension of data representations in deep neural networkscited by 282
  26. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
  27. 2019A Constructive Prediction of the Generalization Error Across Scalescited by 210
  28. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  29. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
  30. 2014Compressing Deep Convolutional Networks using Vector Quantizationcited by 195
  31. 2022It's Raw! Audio Generation with State-Space Modelscited by 171
  32. 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
  33. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
  34. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
  35. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
  36. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  37. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  38. 2021Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysiscited by 76

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 30.

32 papers.

Sort:

By area:

  1. 2025Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learningcited by 10
  2. 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 8
  3. 2026NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfacescited by 7
  4. 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 4
  5. 2026A Negative-Control Protocol for Clinical EEG Foundation-Model Benchmarks: Dataset Identity and External-Cohort Stress Testingcited by 4
  6. 2025Neuroprobe: Evaluating Intracranial Brain Responses to Naturalistic Stimulicited by 3
  7. 2026ZUNA: Flexible EEG Superresolution with Position-Aware Diffusion Autoencoderscited by 3
  8. 2026Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Modelscited by 3
  9. 2026EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Modelscited by 2
  10. 2026The Identity Trap in EEG Foundation Models: A Diagnostic Auditcited by 2
  11. 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decodingcited by 1
  12. 2026Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Modelscited by 1
20 more
  1. 2026Lightweight Adaptation of EEG Foundation Models for Stroke Motor Imagery Decoding: Domain Shift and Subject-Level Robustnesscited by 1
  2. 2026MANAS-2: Constrained Reconstruction for EEG Foundation Modelscited by 1
  3. 2026Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shiftscited by 0
  4. 2026EvoBrain: Continual Learning of EEG Foundation Models Across Heterogeneous BCI Taskscited by 0
  5. 2026NeuroOnline: Bridging Pretraining and Online Adaptation for EEG Foundation Modelscited by 0
  6. 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decodingcited by 0
  7. 2026DiffEEG: A Self-Supervised Denoising Diffusion Model for Learning EEG Generic Representationscited by 0
  8. 2026Differentiable Logic Gate Networks for Low-Latency EEG Classification on Edge Devicescited by 0
  9. 2026Multimodal Pretraining for Generalizable EEG Representation Learningcited by 0
  10. 2026ZUNA1.1: A more flexible EEG foundation model for Denoising and Super-resolutioncited by 0
  11. 2026EEG-PRISM: Physiologically-Grounded Interpretability of Predictions by EEG Foundation Modelscited by 0
  12. 2026Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgetscited by 0
  13. 2026A Roadmap for MEG Foundation Modelscited by 0
  14. 2026EEG-Xplain: Decoding Neural Black-Boxes of EEG Foundation Modelscited by 0
  15. 2026iMINDBench: iEEG Multi-Institution Neural Decoding Benchmarkcited by 0
  16. 2026Neuron-Level Architecture Growth: A Controlled Evaluation for EEG Time-Series Decodingcited by 0
  17. 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Modelscited by 0
  18. 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memorycited by 0
  19. 2026ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Modelscited by 0
  20. 2026Lightweight Semantic EEG Foundation Model for Frozen Cross-Disorder Transfercited by 0