REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects
Not on the map. Why?
Abstract (arXiv)
Foundation models have transformed AI by reducing reliance on task-specific data through large-scale pretraining. While successful in language and vision, their adoption in EEG has lagged due to the heterogeneity of public datasets, which are collected under varying protocols, devices, and electrode configurations. Existing EEG foundation models struggle to generalize across these variations, often restricting pretraining to a single setup, resulting in suboptimal performance, in particular under linear probing. We present REVE (Representation for EEG with Versatile Embeddings), a pretrained model explicitly designed to generalize across diverse EEG signals. REVE introduces a novel 4D positional encoding scheme that enables it to process signals of arbitrary length and electrode arrangement. Using a masked autoencoding objective, we pretrain REVE on over 60,000 hours of EEG data from 92 datasets spanning 25,000 subjects, representing the largest EEG pretraining effort to date. REVE achieves state-of-the-art results on 10 downstream EEG tasks, including motor imagery classification, seizure detection, sleep staging, cognitive load estimation, and emotion recognition. With little to no fine-tuning, it demonstrates strong generalization, and nuanced spatio-temporal modeling. We release code, pretrained weights, and tutorials to support standardized EEG research and accelerate progress in clinical neuroscience.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). Builds on 50 of its 125 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
50 of 125 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Segment Anythingcited by 8,158
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2016Layer Normalizationcited by 5,579
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
38 more
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2023Qwen Technical Reportcited by 3,273
- 2023Mistral 7Bcited by 3,065
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2020GLU Variants Improve Transformercited by 1,724
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
- 2024Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durationscited by 160
- 2022Decoding speech perception from non-invasive brain recordingscited by 129
- 2022On the SDEs and Scaling Rules for Adaptive Gradient Algorithmscited by 100
- 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 92
- 2022Cramming: Training a Language Model on a Single GPU in One Daycited by 81
- 2018Transfer Learning for Brain-Computer Interfaces: A Euclidean Space Data Alignment Approachcited by 76
- 2023Stable and low-precision training for large-scale vision-language modelscited by 74
- 2024Scaling Exponents Across Parameterizations and Optimizerscited by 71
- 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 69
- 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 61
- 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 54
- 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 48
- 2024Why Warmup the Learning Rate? Underlying Mechanisms and Improvementscited by 45
- 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 37
- 2022Learning Imbalanced Data with Vision Transformerscited by 34
- 2024MIM-Refiner: A Contrastive Learning Boost from Intermediate Pre-Trained Representationscited by 19
- 2024S-JEPA: towards seamless cross-dataset transfer through dynamic spatial attentioncited by 13
- 2024Graph Adapter of EEG Foundation Models for Parameter Efficient Fine Tuningcited by 4
- 2015Using Riemannian geometry for SSVEP-based Brain Computer Interfacecited by 2
- 2021Online Optimization of Stimulation Speed in an Auditory Brain-Computer Interface under Time Constraintscited by 2
Built on by
Citing papers per year: 2026: 70.
70 papers.
Sort:
By area:
- 2026NeuralBench: A Unifying Framework to Benchmark NeuroAI Modelscited by 13
- 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 7
- 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 5
- 2026NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfacescited by 5
- 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 5
- 2026Neural Signals Generate Clinical Notes in the Wildcited by 4
- 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelinescited by 4
- 2026BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregressioncited by 4
- 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 3
- 2026LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modelingcited by 3
- 2026Cross-Subject Generalization for EEG Decoding: A Survey of Deep Learning Methodscited by 3
- 2026Mechanistic Interpretability of EEG Foundation Models via Sparse Autoencoderscited by 3
38 more
- 2026Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Modelscited by 3
- 2026A Negative-Control Protocol for Clinical EEG Foundation-Model Benchmarks: Dataset Identity and External-Cohort Stress Testingcited by 3
- 2026NeuroSkill(tm): Proactive Real-Time Agentic System Capable of Modeling Human State of Mindcited by 2
- 2026Channel Adaptation for EEG Foundation Models: A Systematic Benchmark Across Architectures, Tasks, and Training Regimescited by 2
- 2026Same Brain, Different Prediction: How Preprocessing Choices Undermine EEG Decoding Reliabilitycited by 2
- 2026EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Modelscited by 2
- 2026A Systematic Evaluation of Sample-Level Tokenization Strategies for MEG Foundation Modelscited by 1
- 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decodingcited by 1
- 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Taskscited by 1
- 2026CLEF: EEG Foundation Model for Learning Clinical Semanticscited by 1
- 2026Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Modelscited by 1
- 2026CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Modelscited by 1
- 2026The Identity Trap in EEG Foundation Models: A Diagnostic Auditcited by 1
- 2026A spectral audit framework reveals task-dependent aperiodic reliance across EEG and ECG deep learningcited by 1
- 2026Cross-Cohort Spectral-Temporal Dissociation in Frozen EEG Foundation-Model Representationscited by 1
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysiscited by 1
- 2026A New Strategy for Artificial Intelligence: Training Foundation Models Directly on Human Brain Datacited by 0
- 2026Online decoding of rat self-paced locomotion speed from EEG using recurrent neural networkscited by 0
- 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Modelscited by 0
- 2026Standing on the Shoulders of Giants: Rethinking EEG Foundation Model Pretraining via Multi-Teacher Distillationcited by 0
- 2026DLink: Distilling Layer-wise and Dominant Knowledge from EEG Foundation Modelscited by 0
- 2026Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shiftscited by 0
- 2026DANCE: Detect and Classify Events in EEGcited by 0
- 2026MindAlign: Bridging EEG, Vision, and Language for Zero-Shot Visual Decodingcited by 0
- 2026MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognitioncited by 0
- 2026A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularitycited by 0
- 2026Evaluation of EEG Foundation Models for Event-Based Burst-Suppression Detection in ICUcited by 0
- 2026NeuroShield: A Device-Agnostic Foundation Model for EEG Authenticationcited by 0
- 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNetcited by 0
- 2026Temporal Feature Extractors in EEG Foundation Models: A Controlled Comparison Including a Pretrained Time-Series Modelcited by 0
- 2026Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decodingcited by 0
- 2026STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learningcited by 0
- 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decodingcited by 0
- 2026Real-Time EEG Cap Electrode Detection for Guided Point-of-Care Placementcited by 0
- 2026Universal BCI Personalization: One API for Frozen EEG Trunks and Foundation Modelscited by 0
- 2026Rethinking EEG-Based Disease Diagnosis: Decoupling Instance Representation Learning from Subject-Level Supervisioncited by 0
- 2026EEG-JEPA: Structured Latent Prediction for EEG Foundation Modelscited by 0
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understandingcited by 0
50 most cited of 70 All 70 (JSON)
- 2026CortexBridge: Cortical Alignment of EEG Montages for Foundation Models1 Oct 2026
- 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memory29 Sep 2026
- 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Models28 Sep 2026
- 2026AutoBCI: Forecast-Guided Agentic Neural Architecture Discovery for EEG-Based Brain--Computer Interfaces28 Sep 2026
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026When Is an SAE Feature Interpretable? A Validation Ladder for EEG Foundation Models28 Sep 2026
- 2026What masking geometry works best for EEG foundation models?27 Sep 2026
- 2026Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models25 Sep 2026
- 2026Bio-MF: Low-Latency and High-Fidelity EEG-to-fNIRS Cross-Modal Generation for Hybrid Motor-Imagery Brain--Computer Interfaces17 Sep 2026
- 2026Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blocks17 Sep 2026
- 2026MANAS-2: Constrained Reconstruction for EEG Foundation Models12 Sep 2026
- 2026BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classification10 Sep 2026
38 more
- 2026EEGBind: Detecting Source-Level Interictal Epileptiform Discharges via EEG-Centric Multimodal Binding9 Sep 2026
- 2026Adaptive Anisotropic Attention for Axis-Structured Signals8 Sep 2026
- 2026A Roadmap for MEG Foundation Models3 Sep 2026
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysis2 Sep 2026
- 2026EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstruction1 Sep 2026
- 2026Lightweight Adaptation of EEG Foundation Models for Stroke Motor Imagery Decoding: Domain Shift and Subject-Level Robustness31 Aug 2026
- 2026Behavioral Latency as Weak Event-Time Supervision for EEG Reaction-Time Decoding29 Aug 2026
- 2026ReMAP: Self-supervised learning to unveil brain representations and vulnerability22 Aug 2026
- 2026Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models12 Aug 2026
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding4 Aug 2026
- 2026EEG-JEPA: Structured Latent Prediction for EEG Foundation Models31 Jul 2026
- 2026Rethinking EEG-Based Disease Diagnosis: Decoupling Instance Representation Learning from Subject-Level Supervision29 Jul 2026
- 2026A Negative-Control Protocol for Clinical EEG Foundation-Model Benchmarks: Dataset Identity and External-Cohort Stress Testing27 Jul 2026
- 2026Universal BCI Personalization: One API for Frozen EEG Trunks and Foundation Models24 Jul 2026
- 2026Cross-Cohort Spectral-Temporal Dissociation in Frozen EEG Foundation-Model Representations23 Jul 2026
- 2026Real-Time EEG Cap Electrode Detection for Guided Point-of-Care Placement22 Jul 2026
- 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decoding10 Jul 2026
- 2026STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning7 Jul 2026
- 2026Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decoding3 Jul 2026
- 2026Temporal Feature Extractors in EEG Foundation Models: A Controlled Comparison Including a Pretrained Time-Series Model29 Jun 2026
- 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNet18 Jun 2026
- 2026Evaluation of EEG Foundation Models for Event-Based Burst-Suppression Detection in ICU18 Jun 2026
- 2026NeuroShield: A Device-Agnostic Foundation Model for EEG Authentication12 Jun 2026
- 2026A spectral audit framework reveals task-dependent aperiodic reliance across EEG and ECG deep learning7 Jun 2026
- 2026The Identity Trap in EEG Foundation Models: A Diagnostic Audit4 Jun 2026
- 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models30 May 2026
- 2026A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularity28 May 2026
- 2026CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Models27 May 2026
- 2026EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Models26 May 2026
- 2026MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognition26 May 2026
- 2026Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models26 May 2026
- 2026MindAlign: Bridging EEG, Vision, and Language for Zero-Shot Visual Decoding23 May 2026
- 2026Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models17 May 2026
- 2026NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfaces14 May 2026
- 2026Mechanistic Interpretability of EEG Foundation Models via Sparse Autoencoders13 May 2026
- 2026CLEF: EEG Foundation Model for Learning Clinical Semantics11 May 2026
- 2026DANCE: Detect and Classify Events in EEG11 May 2026
- 2026NeuralBench: A Unifying Framework to Benchmark NeuroAI Models8 May 2026
50 newest of 70 All 70 (JSON)
- 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelinescited by 4
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysiscited by 1
- 2026AutoBCI: Forecast-Guided Agentic Neural Architecture Discovery for EEG-Based Brain--Computer Interfacescited by 0
- 2026AutoBCI: Forecast-Guided Agentic Neural Architecture Discovery for EEG-Based Brain--Computer Interfaces28 Sep 2026
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysis2 Sep 2026
- 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelines13 Feb 2026
- 2026NeuralBench: A Unifying Framework to Benchmark NeuroAI Modelscited by 13
- 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 7
- 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 5
- 2026NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfacescited by 5
- 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 5
- 2026Neural Signals Generate Clinical Notes in the Wildcited by 4
- 2026BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregressioncited by 4
- 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 3
- 2026Cross-Subject Generalization for EEG Decoding: A Survey of Deep Learning Methodscited by 3
- 2026Mechanistic Interpretability of EEG Foundation Models via Sparse Autoencoderscited by 3
- 2026Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Modelscited by 3
- 2026A Negative-Control Protocol for Clinical EEG Foundation-Model Benchmarks: Dataset Identity and External-Cohort Stress Testingcited by 3
12 most cited of 64 All 64 (JSON)
- 2026CortexBridge: Cortical Alignment of EEG Montages for Foundation Models1 Oct 2026
- 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memory29 Sep 2026
- 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Models28 Sep 2026
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026When Is an SAE Feature Interpretable? A Validation Ladder for EEG Foundation Models28 Sep 2026
- 2026What masking geometry works best for EEG foundation models?27 Sep 2026
- 2026Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models25 Sep 2026
- 2026Bio-MF: Low-Latency and High-Fidelity EEG-to-fNIRS Cross-Modal Generation for Hybrid Motor-Imagery Brain--Computer Interfaces17 Sep 2026
- 2026Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blocks17 Sep 2026
- 2026MANAS-2: Constrained Reconstruction for EEG Foundation Models12 Sep 2026
- 2026BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classification10 Sep 2026
- 2026EEGBind: Detecting Source-Level Interictal Epileptiform Discharges via EEG-Centric Multimodal Binding9 Sep 2026
12 newest of 64 All 64 (JSON)