mlsanityData to 14 Oct 2026

DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCI

arXiv 2601.06134 ↗First posted 5 Jan 2026cs.LG eess.SP q-bio.NCcited by 9

Not on the map. Why?

Abstract (arXiv)

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing protocols, lacking the intrinsic universality required for broad generalization. This limitation stems from adapting general-purpose sequence architectures that overlook the biophysical and dynamical principles of neural activity. To bridge this gap, we propose DeeperBrain, a neuro-grounded foundation model integrating domain-specific inductive biases into its model design and learning objectives. Architecturally, DeeperBrain incorporates a volume conduction-aware channel encoding to model spatial mixing via 3D geometry, and a neurodynamics-aware temporal encoding capturing slow adaptations using oscillatory and exponential bases. For pretraining, we introduce a dual-objective strategy combining Masked EEG Reconstruction (MER) for local fidelity and Neurodynamics Statistics Prediction (NSP). NSP enforces alignment with macroscopic brain states by predicting interpretable order parameters, including spectral power, functional connectivity, cross-frequency coupling, and dynamic complexity. Extensive experiments demonstrate that DeeperBrain achieves state-of-the-art or highly competitive performance under end-to-end fine-tuning. Crucially, it maintains superior efficacy under a rigorous frozen-probing protocol, verifying that embedding neuroscientific first principles endows learned representations with the intrinsic universality essential for universal BCI. The code will be publicly available.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 54 of its 148 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

54 of 148 references.

References · 54

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2023Segment Anythingcited by 8,234
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  8. 2019Invariant Risk Minimizationcited by 1,854
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  10. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  11. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  12. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
38 more
  1. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  2. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  3. 2019Learning Deep Transformer Models for Machine Translationcited by 309
  4. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
  5. 2023LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Modelscited by 217
  6. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  7. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  8. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 157
  9. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
  10. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  11. 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 91
  12. 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 88
  13. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  14. 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 84
  15. 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
  16. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  17. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  18. 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 62
  19. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
  20. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
  21. 2021TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognitioncited by 52
  22. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
  23. 2020MODMA dataset: a Multi-modal Open Dataset for Mental-disorder Analysiscited by 38
  24. 2021Multi-View Spatial-Temporal Graph Convolutional Networks with Domain Generalization for Sleep Stage Classificationcited by 37
  25. 2021LGGNet: Learning from Local-Global-Graph Representations for Brain-Computer Interfacecited by 36
  26. 2025CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Modelcited by 28
  27. 2025BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signalscited by 27
  28. 2025LUNA: Efficient and Topology-Agnostic Foundation Model for EEG Signal Analysiscited by 26
  29. 2025EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Modelscited by 23
  30. 2025Brain Foundation Models: A Survey on Advancements in Neural Signal Processing and Brain Discoverycited by 22
  31. 2023Generalizable Sleep Staging via Multi-Level Domain Alignmentcited by 17
  32. 2024Brant-X: A Unified Physiological Signal Alignment Frameworkcited by 17
  33. 2025AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applicationscited by 17
  34. 2025Are Large Brainwave Foundation Models Capable Yet? Insights from Fine-tuningcited by 15
  35. 2025UniMind: Unleashing the Power of LLMs for Unified Multi-Task Brain Decodingcited by 14
  36. 2025NeurIPT: Foundation Model for Neural Interfacescited by 11
  37. 2025A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectivescited by 10
  38. 2024Personalized Sleep Staging Leveraging Source-free Unsupervised Domain Adaptationcited by 7

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.