mlsanityData to 7 Oct 2026

REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects

arXiv 2510.21585 ↗First posted 24 Oct 2025cs.LG q-bio.NCcited by 70

Not on the map. Why?

Abstract (arXiv)

Foundation models have transformed AI by reducing reliance on task-specific data through large-scale pretraining. While successful in language and vision, their adoption in EEG has lagged due to the heterogeneity of public datasets, which are collected under varying protocols, devices, and electrode configurations. Existing EEG foundation models struggle to generalize across these variations, often restricting pretraining to a single setup, resulting in suboptimal performance, in particular under linear probing. We present REVE (Representation for EEG with Versatile Embeddings), a pretrained model explicitly designed to generalize across diverse EEG signals. REVE introduces a novel 4D positional encoding scheme that enables it to process signals of arbitrary length and electrode arrangement. Using a masked autoencoding objective, we pretrain REVE on over 60,000 hours of EEG data from 92 datasets spanning 25,000 subjects, representing the largest EEG pretraining effort to date. REVE achieves state-of-the-art results on 10 downstream EEG tasks, including motor imagery classification, seizure detection, sleep staging, cognitive load estimation, and emotion recognition. With little to no fine-tuning, it demonstrates strong generalization, and nuanced spatio-temporal modeling. We release code, pretrained weights, and tutorials to support standardized EEG research and accelerate progress in clinical neuroscience.

Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). Builds on 50 of its 125 references that are in the map. First posted on arXiv 24 Oct 2025.

Builds on

50 of 125 references.

References · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Segment Anythingcited by 8,158
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  10. 2020Scaling Laws for Neural Language Modelscited by 6,411
  11. 2016Layer Normalizationcited by 5,579
  12. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
38 more
  1. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  2. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2023Mistral 7Bcited by 3,065
  5. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  6. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  7. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  8. 2020GLU Variants Improve Transformercited by 1,724
  9. 2019Root Mean Square Layer Normalizationcited by 1,425
  10. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  11. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  12. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
  13. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  14. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
  15. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  16. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
  17. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
  18. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
  19. 2024Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durationscited by 160
  20. 2022Decoding speech perception from non-invasive brain recordingscited by 129
  21. 2022On the SDEs and Scaling Rules for Adaptive Gradient Algorithmscited by 100
  22. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 92
  23. 2022Cramming: Training a Language Model on a Single GPU in One Daycited by 81
  24. 2018Transfer Learning for Brain-Computer Interfaces: A Euclidean Space Data Alignment Approachcited by 76
  25. 2023Stable and low-precision training for large-scale vision-language modelscited by 74
  26. 2024Scaling Exponents Across Parameterizations and Optimizerscited by 71
  27. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 69
  28. 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 61
  29. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 54
  30. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 48
  31. 2024Why Warmup the Learning Rate? Underlying Mechanisms and Improvementscited by 45
  32. 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 37
  33. 2022Learning Imbalanced Data with Vision Transformerscited by 34
  34. 2024MIM-Refiner: A Contrastive Learning Boost from Intermediate Pre-Trained Representationscited by 19
  35. 2024S-JEPA: towards seamless cross-dataset transfer through dynamic spatial attentioncited by 13
  36. 2024Graph Adapter of EEG Foundation Models for Parameter Efficient Fine Tuningcited by 4
  37. 2015Using Riemannian geometry for SSVEP-based Brain Computer Interfacecited by 2
  38. 2021Online Optimization of Stimulation Speed in an Auditory Brain-Computer Interface under Time Constraintscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 70.

70 papers.

Sort:

By area:

  1. 2026NeuralBench: A Unifying Framework to Benchmark NeuroAI Modelscited by 13
  2. 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 7
  3. 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 5
  4. 2026NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfacescited by 5
  5. 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 5
  6. 2026Neural Signals Generate Clinical Notes in the Wildcited by 4
  7. 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelinescited by 4
  8. 2026BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregressioncited by 4
  9. 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 3
  10. 2026LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modelingcited by 3
  11. 2026Cross-Subject Generalization for EEG Decoding: A Survey of Deep Learning Methodscited by 3
  12. 2026Mechanistic Interpretability of EEG Foundation Models via Sparse Autoencoderscited by 3
38 more
  1. 2026Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Modelscited by 3
  2. 2026A Negative-Control Protocol for Clinical EEG Foundation-Model Benchmarks: Dataset Identity and External-Cohort Stress Testingcited by 3
  3. 2026NeuroSkill(tm): Proactive Real-Time Agentic System Capable of Modeling Human State of Mindcited by 2
  4. 2026Channel Adaptation for EEG Foundation Models: A Systematic Benchmark Across Architectures, Tasks, and Training Regimescited by 2
  5. 2026Same Brain, Different Prediction: How Preprocessing Choices Undermine EEG Decoding Reliabilitycited by 2
  6. 2026EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Modelscited by 2
  7. 2026A Systematic Evaluation of Sample-Level Tokenization Strategies for MEG Foundation Modelscited by 1
  8. 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decodingcited by 1
  9. 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Taskscited by 1
  10. 2026CLEF: EEG Foundation Model for Learning Clinical Semanticscited by 1
  11. 2026Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Modelscited by 1
  12. 2026CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Modelscited by 1
  13. 2026The Identity Trap in EEG Foundation Models: A Diagnostic Auditcited by 1
  14. 2026A spectral audit framework reveals task-dependent aperiodic reliance across EEG and ECG deep learningcited by 1
  15. 2026Cross-Cohort Spectral-Temporal Dissociation in Frozen EEG Foundation-Model Representationscited by 1
  16. 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysiscited by 1
  17. 2026A New Strategy for Artificial Intelligence: Training Foundation Models Directly on Human Brain Datacited by 0
  18. 2026Online decoding of rat self-paced locomotion speed from EEG using recurrent neural networkscited by 0
  19. 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Modelscited by 0
  20. 2026Standing on the Shoulders of Giants: Rethinking EEG Foundation Model Pretraining via Multi-Teacher Distillationcited by 0
  21. 2026DLink: Distilling Layer-wise and Dominant Knowledge from EEG Foundation Modelscited by 0
  22. 2026Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shiftscited by 0
  23. 2026DANCE: Detect and Classify Events in EEGcited by 0
  24. 2026MindAlign: Bridging EEG, Vision, and Language for Zero-Shot Visual Decodingcited by 0
  25. 2026MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognitioncited by 0
  26. 2026A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularitycited by 0
  27. 2026Evaluation of EEG Foundation Models for Event-Based Burst-Suppression Detection in ICUcited by 0
  28. 2026NeuroShield: A Device-Agnostic Foundation Model for EEG Authenticationcited by 0
  29. 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNetcited by 0
  30. 2026Temporal Feature Extractors in EEG Foundation Models: A Controlled Comparison Including a Pretrained Time-Series Modelcited by 0
  31. 2026Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decodingcited by 0
  32. 2026STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learningcited by 0
  33. 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decodingcited by 0
  34. 2026Real-Time EEG Cap Electrode Detection for Guided Point-of-Care Placementcited by 0
  35. 2026Universal BCI Personalization: One API for Frozen EEG Trunks and Foundation Modelscited by 0
  36. 2026Rethinking EEG-Based Disease Diagnosis: Decoupling Instance Representation Learning from Subject-Level Supervisioncited by 0
  37. 2026EEG-JEPA: Structured Latent Prediction for EEG Foundation Modelscited by 0
  38. 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understandingcited by 0

50 most cited of 70 All 70 (JSON)