mlsanityData to 14 Oct 2026

What Do EEG Foundation Models Capture from Human Brain Signals?

arXiv 2605.11410 ↗First posted 12 May 2026cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Clinical electroencephalogram (EEG) analysis rests on a hand-crafted feature catalog refined over decades, e.g., band power, connectivity, complexity, and more. Modern EEG foundation models bypass this catalog, learn directly from raw signals via self-supervised pretraining, and match or outperform feature-engineered baselines on most clinical benchmarks. Whether the two representations align is an open question, which we decompose into three sub-questions: what does the model learn, what does the model use, and how much can be explained. We answer them with layer-wise ridge probing, LEACE-style cross-covariance subspace erasure, and a transparent classifier benchmarked against a random-feature baseline. The audit covers three foundation models (CSBrain, CBraMod, LaBraM), five clinical tasks (MDD, Stress, ISRUC-Sleep, TUSL, Siena), and a 6-family 63-feature lexicon. Of the 945 (model, task, feature) units, 648 (68.6%) are representation-causal and 199 (21.1%) are encoded-only. Across tasks, 50 features qualify as universal candidates with strong support (all three architectures RC) in two or more tasks. Frequency-domain features dominate, but the other five families each contribute substantial causal mass. Confirmed features recover, on average, 79.3% of the foundation model's advantage over the random baseline, with a clean task gradient (MDD ≈ 0.99 down to Stress ≈ 0.56): tasks near ceiling are almost fully recovered by the lexicon, while harder tasks leave a non-trivial residual that pinpoints a concrete target for future concept discovery.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 47 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

17 of 47 references.

References · 17

  1. 2020Concept Bottleneck Modelscited by 1,032
  2. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  3. 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 457
  4. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
  5. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  6. 2023LEACE: Perfect linear concept erasure in closed formcited by 267
  7. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  8. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  9. 2022Linear Adversarial Concept Erasurecited by 101
  10. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  11. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  12. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
5 more
  1. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
  2. 2022Kernelized Concept Erasurecited by 48
  3. 2017Neural network an1alysis of sleep stages enables efficient diagnosis of narcolepsycited by 41
  4. 2023Concept-based explainability for an EEG transformer modelcited by 8
  5. 2023An Explainable Deep Learning-Based Method For Schizophrenia Diagnosis Using Generative Data-Augmentationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.