# Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal

arXiv: https://arxiv.org/abs/2602.11558 · HTML: https://mlsanity.com/paper/2602.11558/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 40 of its 89 references that are in the map.
- First posted on arXiv 12 Feb 2026.

## Builds on (most cited first, 30 of 40)

- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Masked Autoencoders Are Scalable Vision Learners](https://mlsanity.com/paper/2111.06377/) (2021)
- [Neural Discrete Representation Learning](https://mlsanity.com/paper/1711.00937/) (2017)
- [wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://mlsanity.com/paper/2006.11477/) (2020)
- [Self-supervised Learning: Generative or Contrastive](https://mlsanity.com/paper/2006.08218/) (2020)
- [Data-Efficient Image Recognition with Contrastive Predictive Coding](https://mlsanity.com/paper/1905.09272/) (2019)
- [Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI](https://mlsanity.com/paper/2405.18765/) (2024)
- [Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency](https://mlsanity.com/paper/2206.08496/) (2022)
- [BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG data](https://mlsanity.com/paper/2101.12037/) (2021)
- [CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding](https://mlsanity.com/paper/2412.07236/) (2024)
- [NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signals](https://mlsanity.com/paper/2409.00101/) (2024)
- [REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects](https://mlsanity.com/paper/2510.21585/) (2025)
- [Neuro-GPT: Towards A Foundation Model for EEG](https://mlsanity.com/paper/2311.03764/) (2023)
- [BrainBERT: Self-supervised representation learning for intracranial recordings](https://mlsanity.com/paper/2302.14367/) (2023)
- [MAEEG: Masked Auto-encoder for EEG Representation Learning](https://mlsanity.com/paper/2211.02625/) (2022)
- [EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Model](https://mlsanity.com/paper/2401.10278/) (2024)
- [EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs](https://mlsanity.com/paper/2402.17772/) (2024)
- [Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer](https://mlsanity.com/paper/2205.09928/) (2022)
- [CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Model](https://mlsanity.com/paper/2506.09110/) (2025)
- [BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signals](https://mlsanity.com/paper/2505.18185/) (2025)
- [MBrain: A Multi-channel Self-Supervised Learning Framework for Brain Signals](https://mlsanity.com/paper/2306.13102/) (2023)
- [BrainWave: A Brain Signal Foundation Model for Clinical Applications](https://mlsanity.com/paper/2402.10251/) (2024)
- [EEG2TEXT: Open Vocabulary EEG-to-Text Decoding with EEG Pre-Training and Multi-View Transformer](https://mlsanity.com/paper/2405.02165/) (2024)
- [Neuro-BERT: Rethinking Masked Autoencoding for Self-supervised Neurological Pretraining](https://mlsanity.com/paper/2204.12440/) (2022)
- [CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attention](https://mlsanity.com/paper/2501.10885/) (2025)
- [UniMind: Unleashing the Power of LLMs for Unified Multi-Task Brain Decoding](https://mlsanity.com/paper/2506.18962/) (2025)
- [mulEEG: A Multi-View Representation Learning on EEG Signals](https://mlsanity.com/paper/2204.03272/) (2022)
- [Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusion](https://mlsanity.com/paper/2409.19130/) (2024)
- [Towards Neural Foundation Models for Vision: Aligning EEG, MEG, and fMRI Representations for Decoding, Encoding, and Modality Conversion](https://mlsanity.com/paper/2411.09723/) (2024)
- [Eeg2vec: Self-Supervised Electroencephalographic Representation Learning](https://mlsanity.com/paper/2305.13957/) (2023)

## Built on by (most cited first, 7 of 7)

- [NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfaces](https://mlsanity.com/paper/2605.14698/) (2026)
- [The Identity Trap in EEG Foundation Models: A Diagnostic Audit](https://mlsanity.com/paper/2606.06647/) (2026)
- [SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding](https://mlsanity.com/paper/2603.16739/) (2026)
- [BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding](https://mlsanity.com/paper/2608.04156/) (2026)
- [Matched-Input Estimates Differ in Sign Across Architectures: Auditing EEG Foundation Models on Motor Imagery](https://mlsanity.com/paper/2609.23924/) (2026)
- [Benchmarking EEG Foundation Models at Scale: Lessons from 20,000 Evaluations](https://mlsanity.com/paper/2609.32743/) (2026)
- [EMG-FM-Bench: A Comprehensive Benchmark for Foundation Model Transfer and Adaptation on Electromyography](https://mlsanity.com/paper/2610.06450/) (2026)

## Abstract (arXiv)

Brain foundation models (BFMs) are advancing neurotechnology by learning transferable representations from neural signals, with broad potential in clinical diagnosis and neuroscience research. Their development relies on large-scale pretraining corpora of electrical brain signals, including scalp electroencephalography (EEG) and intracranial EEG (iEEG). However, existing BFM benchmarks primarily focus on EEG, cover only a limited subset of models, and provide limited analysis beyond downstream performance. We introduce Brain4FMs, the first unified benchmark, to our knowledge, for jointly evaluating BFMs on EEG and iEEG. It integrates 17 representative models and 21 public datasets across clinical diagnosis, sleep staging, communication, and affective computing. Brain4FMs is open and plug-and-play, with dataset-aware preprocessing, cross-subject evaluation, heterogeneous multichannel handling, and standardized downstream adaptation workflows. The benchmark reveals performance variation across tasks, signal modalities, and adaptation protocols, with no single BFM consistently dominating all evaluation scenarios. % To better understand these heterogeneous transfer behaviors, we further conduct exploratory analyses of model-specific properties. To better understand these behaviors, we further conduct exploratory analyses of model-specific properties of spatial, spectral, and discrete representations. The code is available at https://github.com/wajtsq/Brain4FMs.