mlsanityData to 14 Oct 2026

SingLEM: Single-Channel Large EEG Model

arXiv 2509.17920 ↗First posted 22 Sep 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Current deep learning models for electroencephalography (EEG) are often task-specific and depend on large labeled datasets, limiting their adaptability. Although EEG foundation models seek broader applicability, many still rely on predefined multi-channel inputs, electrode-layout assumptions, or model-specific channel handling. To address these limitations, we introduce the Single-Channel Large EEG Model (SingLEM), a self-supervised foundation model whose hybrid convolutional--Transformer encoder maps each channel independently to a reusable representation capturing local and long-range temporal structure. These representations can be used individually or combined through channel-wise feature concatenation. We assembled 71 public EEG datasets comprising approximately 9,200 subjects and 357,000 single-channel hours. For leakage-controlled evaluation, downstream results were obtained with a model pretrained on 68 datasets after excluding the three source datasets underlying the six tasks. A model pretrained on all 71 datasets is provided for general reuse. Across six motor imagery and cognitive tasks under strict leave-one-subject-out (LOSO) evaluation, the leakage-controlled model with concatenated representations and a support vector machine (SVM) classifier achieved the best overall performance among the compared pretrained and classical feature-based methods. Additional classifier and subject-adapted analyses supported the robustness of its representations. These findings support single-channel self-supervised learning as a montage-flexible foundation for reusable EEG feature extraction and electrode-level spatial analysis. The source code and pretrained models are available at https://github.com/ttlabtuat/SingLEM.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 123 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

25 of 123 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  6. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  7. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  8. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  9. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  10. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 157
  11. 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
  12. 2018The Temple University Hospital Seizure Detection Corpuscited by 83
13 more
  1. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  2. 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
  3. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  4. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
  5. 2020MODMA dataset: a Multi-modal Open Dataset for Mental-disorder Analysiscited by 38
  6. 2018Improved EEG Event Classification Using Differential Energycited by 32
  7. 2018Multi-channel EEG recordings during a sustained-attention driving taskcited by 32
  8. 2025CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Modelcited by 28
  9. 2024EEG-Deformer: A Dense Convolutional Transformer for Brain-computer Interfacescited by 26
  10. 2024EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion Recognitioncited by 24
  11. 2022A Transformer-based deep neural network model for SSVEP classificationcited by 14
  12. 2021Automated Detection of Abnormalities from an EEG Recording of Epilepsy Patients With a Compact Convolutional Neural Networkcited by 3
  13. 2025DIVER-0 : A Fully Channel Equivariant EEG Foundation Modelcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.