Mechanistic Interpretability of EEG Foundation Models via Sparse Autoencoders
On the map: Mechanistic interpretability → Interpreting biomedical and science models
Abstract (arXiv)
EEG foundation models achieve state-of-the-art clinical performance, yet the internal computations driving their predictions remain opaque: a barrier to clinical trust. We apply TopK Sparse Autoencoders (SAEs) across three architecturally distinct EEG transformers: SleepFM, REVE, and LaBraM to extract sparse feature dictionaries from their embeddings. By grounding these features in a clinical taxonomy (abnormality, age, sex, and medication), we benchmark monosemanticity and entanglement across architectures. A single hyperparameter procedure, driven by an intrinsic dictionary health audit, transfers robustly across all three architectures. Via concept steering, we introduce a "target vs. off-target" probe area metric to quantify steering selectivity and reveal three operational regimes: selectively steerable, encoded but entangled, and non-encoded. This framework exposes critical representational failures: "wrecking-ball" interventions that collapse global model performance, and clinical entanglements, such as age-pathology confounding, where it is impossible to suppress one concept without corrupting the other. Finally, a spectral decoder maps these interventions back to the amplitude spectrum, translating latent manipulations into physiologically interpretable frequency signatures, such as pathological slow-wave suppression and α-band restoration.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Interpreting biomedical and science models, one of 13 directions in Mechanistic interpretability. Builds on 20 of its 29 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
20 of 29 references.
Closest ancestors · 3
Same direction, newest first
- 2025MedSAE: Dissecting MedCLIP Representations with Sparse Autoencoders30 Oct
- 2025Mammo-SAE: Interpreting Breast Cancer Concept Learning with Sparse Autoencoders21 Jul
- 2024InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders13 Nov
Other references · 17
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2022Toy Models of Superpositioncited by 971
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 394
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2023LEACE: Perfect linear concept erasure in closed formcited by 267
- 2013k-Sparse Autoencoderscited by 215
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
5 more
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
- 2023Concept-based explainability for an EEG transformer modelcited by 8
- 2024SPEED: Scalable Preprocessing of EEG Data for Self-Supervised Learningcited by 4
- 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Taskscited by 2
- 2026Clinical Feasibility of Smartphone-based EEG in Kenyacited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Cross-Cohort Spectral-Temporal Dissociation in Frozen EEG Foundation-Model Representationscited by 1
- 2026ECG-InterpBench: Benchmarking the Interpretability of ECG Foundation Models with Matched-Scale Sparse Autoencoderscited by 0
- 2026Interpretable MEG Decoding of Perceived Speech: Cortical Sources and the Stimulus Features That Drive Retrievalcited by 0
- 2026Learning transferable human physiology from two million hours of sleep with SleepFM-2cited by 0
- 2026Clinical Concept Centers in LLMscited by 0
- 2026Clinical Concept Centers in LLMs2 Oct 2026
- 2026Learning transferable human physiology from two million hours of sleep with SleepFM-26 Sep 2026
- 2026Interpretable MEG Decoding of Perceived Speech: Cortical Sources and the Stimulus Features That Drive Retrieval2 Aug 2026
- 2026ECG-InterpBench: Benchmarking the Interpretability of ECG Foundation Models with Matched-Scale Sparse Autoencoders29 Jul 2026
- 2026Cross-Cohort Spectral-Temporal Dissociation in Frozen EEG Foundation-Model Representations23 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026PRISM: Exploring Heterogeneous Pretrained EEG Foundation Model Transfer to Clinical Differential Diagnosis
- 2026NeuroNarrator: A Generalist EEG-to-Text Foundation Model for Clinical Interpretation via Spectro-Spatial Grounding and Temporal State-Space Reasoning
- 2026BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregression
- 2024Enhancing Neural Network Interpretability with Feature-Aligned Sparse Autoencoders
- 2025Resurrecting the Salmon: Rethinking Mechanistic Interpretability with Domain-Specific Sparse Autoencoders
- 2026SENSE: Efficient EEG-to-Text via Privacy-Preserving Semantic Retrieval
- 2026CADENCE: A Cardiac Atom Dictionary for Interpretable Neural Concept Extraction from ECG Foundation Models
- 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Models