mlsanityData to 14 Oct 2026

A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectives

arXiv 2504.20069 ↗First posted 24 Apr 2025cs.LG cs.AI eess.SPcited by 10

Not on the map. Why?

Abstract (arXiv)

Electroencephalogram (EEG) signals play a crucial role in understanding brain activity and diagnosing neurological diseases. Because supervised EEG encoders are unable to learn robust EEG patterns and rely too heavily on expensive signal annotation, research has turned to general-purpose self-supervised EEG encoders, known as EEG-based models (EEG-FMs), to achieve robust and scalable EEG feature extraction. However, the readiness of early EEG-FMs for practical applications and the standards for long-term research progress remain unclear. Therefore, a systematic and comprehensive review of first-generation EEG-FMs is necessary to understand their current state-of-the-art and identify key directions for future EEG-FMs. To this end, this study reviews 14 early EEG-FMs and provides a critical comprehensive analysis of their methodologies, empirical findings, and unaddressed research gaps. This review focuses on the latest developments in EEG-based models (EEG-FMs), which have shown great potential for processing and analyzing EEG data. We discuss various EEG-FMs, including their architectures, pretraining strategies, pretraining and downstream datasets, and other details. This review also highlights challenges and future directions in the field, aiming to provide a comprehensive overview for researchers and practitioners interested in EEG analysis and related EEG-FM.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 24 of its 122 references that are in the map. First posted on arXiv 24 Apr 2025.

Builds on

24 of 122 references.

References · 24

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  4. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  5. 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 303
  6. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  7. 2024Large Language Models Meet NLP: A Surveycited by 103
  8. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  9. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  10. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  11. 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 52
  12. 2022EEG based Emotion Recognition: A Tutorial and Reviewcited by 43
12 more
  1. 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 38
  2. 2019A review of feature extraction and performance evaluation in epileptic seizure detection using EEGcited by 29
  3. 2018ChronoNet: A Deep Recurrent Neural Network for Abnormal EEG Identificationcited by 27
  4. 2024EEG-GPT: Exploring Capabilities of Large Language Models for EEG Classification and Interpretationcited by 27
  5. 2023MBrain: A Multi-channel Self-Supervised Learning Framework for Brain Signalscited by 26
  6. 2023BIOT: Cross-data Biosignal Learning in the Wildcited by 20
  7. 2022Evaluating Latent Space Robustness and Uncertainty of EEG-ML Models under Realistic Distribution Shiftscited by 16
  8. 2024FoME: A Foundation Model for EEG using Adaptive Temporal-Lateral Attention Scalingcited by 16
  9. 2019Prediction of Reaction Time and Vigilance Variability from Spatiospectral Features of Resting-State EEG in a Long Sustained Attention Taskcited by 15
  10. 2023Large Language Models Meet Computer Vision: A Brief Surveycited by 5
  11. 2024GEFM: Graph-Enhanced EEG Foundation Modelcited by 4
  12. 2022Assessing Fatigue with Multimodal Wearable Sensors and Machine Learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 5.

10 papers.