mlsanityData to 7 Oct 2026

The Identity Trap in EEG Foundation Models: A Diagnostic Audit

arXiv 2606.06647 ↗First posted 4 Jun 2026cs.LG q-bio.NCcited by 1

Not on the map. Why?

Abstract (arXiv)

Objective. EEG foundation models (FMs) report strong accuracy on clinical resting-state EEG. However, high accuracy under subject-disjoint cross-validation remains ambiguous: it can reflect a genuine clinical biomarker, or subject-identity features that correlate with the label. We name this the Identity Trap and ask whether it can be diagnosed at the representation level before fine-tuning. Approach. We propose FMScope, a frozen-representation protocol packaging five diagnostics: variance decomposition, subject-axis erasure, aperiodic 1/f ablation, layer-wise label probing, and within-subject direction consistency. We apply it to three pretrained FMs (LaBraM, CBraMod, REVE) across four datasets in a 2x2 layout: subject relation of label x presence of a consensus cross-subject EEG marker. Main results. (i) The Identity Trap is universal: frozen subject-variance is 13-89x a random null in 12/12 pairs, rising in all 12 under fine-tuning (+10 to +63 pp). This dominance is a removable linear axis: erasing it improves label decoding where the label varies within subject (+6 to +12 pp in primary cells; +4 to +27 pp across external cohorts). (ii) Aperiodic 1/f is one subject carrier: removing it drops the subject probe by 9-19 pp on LaBraM and CBraMod. REVE saturates subject identity without measurable aperiodic dependence. (iii) Fine-tuning amplifies label-variance only in cells with a literature-established cross-subject marker. Significance. The Identity Trap is a physically-grounded instance of shortcut learning: the preferred cue has a measurable physiological component, and subject-disjoint splitting alone cannot rule it out. FMScope separates gains reflecting a biological marker from those reflecting subject identity.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 54 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

25 of 54 references.

References · 25

  1. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  2. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  3. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  4. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
  5. 2023LEACE: Perfect linear concept erasure in closed formcited by 254
  6. 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
  7. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
  8. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
  9. 2018A mathematical theory of semantic development in deep neural networkscited by 182
  10. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
  11. 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 70
  12. 2025EEG Foundation Models: A Critical Review of Current Progress and Future Directionscited by 30
13 more
  1. 2024Understanding Linear Probing then Fine-tuning Language Models from NTK Perspectivecited by 21
  2. 2025EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Modelscited by 21
  3. 2024Parameter Efficient Fine-tuning via Explained Variance Adaptationcited by 17
  4. 2025AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applicationscited by 16
  5. 2014Demixed principal component analysis of population activity in higher cortical areas reveals independent representation of task parameterscited by 15
  6. 2025EEG Foundation Challenge: From Cross-Task to Cross-Subject EEG Decodingcited by 12
  7. 2025EEG-Bench: A Benchmark for EEG Foundation Models in Clinical Applicationscited by 12
  8. 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 5
  9. 2025Mitigating Subject Dependency in EEG Decoding with Subject-Specific Low-Rank Adapterscited by 4
  10. 2020EEG fingerprinting: subject specific signature based on the aperiodic component of power spectrumcited by 3
  11. 2026What Do EEG Foundation Models Capture from Human Brain Signals?cited by 3
  12. 2025From Theory to Application: Fine-Tuning Large EEG Model with Real-World Stress Datacited by 2
  13. 2026SCOPE: Structured Prototype-Guided Adaptation for EEG Foundation Models with Limited Labelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.