Lightweight Semantic EEG Foundation Model for Frozen Cross-Disorder Transfer
Not on the map. Why?
Abstract (arXiv)
Large-scale EEG foundation models have demonstrated promising transferability across neurological disorders, but often require millions of parameters and substantial computational resources. In this paper, we present the Universal Semantic EEG Foundation Model (USE-FM), a lightweight EEG foundation model that learns transferable neural representations through self-supervised signal reconstruction on the Temple University Hospital EEG Corpus (TUEG). After pretraining, the encoder is frozen and evaluated on two clinically distinct downstream tasks, abnormal EEG detection (TUAB) and epileptic seizure recognition (TUEP), using a unified frozen-transfer protocol against recent EEG foundation models, including LUNA-Base and CBraMod. With only 1.46 million parameters, approximately one-fifth the size of existing models, USE-FM achieves competitive overall performance, including strong sensitivity and F1-score on TUEP (SEN 75.00 ± 14.14, F1 70.37 ± 4.01), while maintaining competitive performance on TUAB (AUC 85.24 ± 5.61). Beyond downstream classification, latent representation analysis using k-means clustering together with PCA and t-SNE demonstrates that USE-FM learns organized semantic EEG representations comparable to substantially larger foundation models. These results suggest that large-scale self-supervised pretraining enables lightweight architectures to learn transferable semantic EEG representations, providing a computationally efficient foundation for cross-disorder analysis and future clinical decision support in neurological disorders.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
14 of 27 references.
References · 14
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
- 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
- 2021Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognitioncited by 60
- 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
- 2025EEG Foundation Models: A Critical Review of Current Progress and Future Directionscited by 32
- 2025LUNA: Efficient and Topology-Agnostic Foundation Model for EEG Signal Analysiscited by 26
- 2025MindAligner: Explicit Brain Functional Alignment for Cross-Subject Visual Decoding from Limited fMRI Datacited by 18
2 more
Built on by
Not cited yet.