mlsanityData to 14 Oct 2026

CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding

arXiv 2506.23075 ↗First posted 29 Jun 2025cs.HC cs.LG eess.SPcited by 53

Not on the map. Why?

Abstract (arXiv)

Understanding and decoding brain activity from electroencephalography (EEG) signals is a fundamental challenge in neuroscience and AI, with applications in cognition, emotion recognition, diagnosis, and brain-computer interfaces. While recent EEG foundation models advance generalized decoding via unified architectures and large-scale pretraining, they adopt a scale-agnostic dense modeling paradigm inherited from NLP and vision. This design neglects a core property of neural activity: cross-scale spatiotemporal structure. EEG task patterns span a wide range of temporal and spatial scales, from short bursts to slow rhythms, and from localized cortical responses to distributed interactions. Ignoring this diversity leads to suboptimal representations and weak generalization. We propose CSBrain, a Cross-scale Spatiotemporal Brain foundation model for generalized EEG decoding. CSBrain introduces: (i) Cross-scale Spatiotemporal Tokenization (CST), which aggregates multi-scale features from localized temporal windows and anatomical brain regions into compact scale-aware tokens; and (ii) Structured Sparse Attention (SSA), which captures cross-window and cross-region dependencies, enhancing scale diversity while removing spurious correlations. CST and SSA are alternately stacked to progressively integrate multi-scale dependencies. Experiments on 11 EEG tasks across 16 datasets show that CSBrain consistently outperforms task-specific and foundation model baselines. These results establish cross-scale modeling as a key inductive bias and position CSBrain as a robust backbone for future brain-AI research.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 46 of its 119 references that are in the map. First posted on arXiv 29 Jun 2025.

Builds on

46 of 119 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  9. 2020Scaling Laws for Neural Language Modelscited by 6,586
  10. 2014Going Deeper with Convolutionscited by 4,241
  11. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  12. 2020Self-supervised Learning: Generative or Contrastivecited by 694
34 more
  1. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  2. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 527
  3. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  4. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  5. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  6. 2019EEG-Based Emotion Recognition Using Regularized Graph Neural Networkscited by 97
  7. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  8. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  9. 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 84
  10. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  11. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  12. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
  13. 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
  14. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
  15. 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 43
  16. 2022EEG based Emotion Recognition: A Tutorial and Reviewcited by 43
  17. 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 38
  18. 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 34
  19. 2016A Multimodal Approach to Estimating Vigilance Using EEG and Forehead EOGcited by 33
  20. 2021Self-supervised EEG Representation Learning for Automatic Sleep Stagingcited by 32
  21. 2021EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signalscited by 28
  22. 2018ChronoNet: A Deep Recurrent Neural Network for Abnormal EEG Identificationcited by 27
  23. 2023Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learningcited by 27
  24. 2024BrainWave: A Brain Signal Foundation Model for Clinical Applicationscited by 26
  25. 2024Neuro-3D: Towards 3D Visual Decoding from EEG Signalscited by 23
  26. 2023Graph Neural Network-based EEG Classification: A Surveycited by 21
  27. 2025MindAligner: Explicit Brain Functional Alignment for Cross-Subject Visual Decoding from Limited fMRI Datacited by 18
  28. 2022Toward reliable signals decoding for electroencephalogram: A benchmark study to EEGNeXcited by 17
  29. 2023Generalizable Sleep Staging via Multi-Level Domain Alignmentcited by 17
  30. 2024Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognitioncited by 17
  31. 2025UniMind: Unleashing the Power of LLMs for Unified Multi-Task Brain Decodingcited by 14
  32. 2025A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectivescited by 10
  33. 2024Graph Neural Networks in EEG-based Emotion Recognition: A Surveycited by 6
  34. 2023GNN4EEG: A Benchmark and Toolkit for Electroencephalography Classification with Graph Neural Networkcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 43.

53 papers.

Sort:

By area:

  1. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
  2. 2025EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Modelscited by 23
  3. 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
  4. 2025Neural Codecs as Biosignal Tokenizerscited by 14
  5. 2025Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learningcited by 10
  6. 2025SynBrain: Enhancing Visual-to-fMRI Synthesis via Probabilistic Representation Learningcited by 9
  7. 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 9
  8. 2025ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Modelscited by 7
  9. 2026Let EEG Models Learn EEGcited by 7
  10. 2025MIRepNet: A Pipeline and Foundation Model for EEG-Based Motor Imagery Classificationcited by 5
  11. 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelinescited by 4
  12. 2025SingLEM: Single-Channel Large EEG Modelcited by 3
38 more
  1. 2026What Do EEG Foundation Models Capture from Human Brain Signals?cited by 3
  2. 2026Brain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEGcited by 2
  3. 2026Same Brain, Different Prediction: How Preprocessing Choices Undermine EEG Decoding Reliabilitycited by 2
  4. 2026KAST-BAR: Knowledge-Anchored Semantically-Dynamic Topology Brain Autoregressive Modeling for Universal Neural Interpretationcited by 2
  5. 2026SCOPE: Structured Prototype-Guided Adaptation for EEG Foundation Models with Limited Labelscited by 1
  6. 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decodingcited by 1
  7. 2026CLEF: EEG Foundation Model for Learning Clinical Semanticscited by 1
  8. 2026A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Modelscited by 1
  9. 2026MANAS-2: Constrained Reconstruction for EEG Foundation Modelscited by 1
  10. 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
  11. 2025Fusion of Multiscale Features Via Centralized Sparse-attention Network for EEG Decodingcited by 0
  12. 2026NeuroFlow: Toward Unified Visual Encoding and Decoding from Neural Activitycited by 0
  13. 2026A Multimodal Pre-trained Network for Integrated EEG-Video Seizure Detectioncited by 0
  14. 2026MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognitioncited by 0
  15. 2026Context-aware tokenization for Cross-subject Emotion Decoding from EEGcited by 0
  16. 2026EvoBrain: Continual Learning of EEG Foundation Models Across Heterogeneous BCI Taskscited by 0
  17. 2026Channel-Preserving Representation Alignment for EEG-to-Music Reconstructioncited by 0
  18. 2026RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learningcited by 0
  19. 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNetcited by 0
  20. 2026SPOTR: Spatio-temporal Pooling One-Token Reconstruction for Universal Physiological Signal Self-supervised Learningcited by 0
  21. 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decodingcited by 0
  22. 2026STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decodingcited by 0
  23. 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understandingcited by 0
  24. 2026Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Modelscited by 0
  25. 2026Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health taskscited by 0
  26. 2026EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstructioncited by 0
  27. 2026Adaptive Anisotropic Attention for Axis-Structured Signalscited by 0
  28. 2026BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classificationcited by 0
  29. 2026Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blockscited by 0
  30. 2026Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Modelscited by 0
  31. 2026RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEGcited by 0
  32. 2026What masking geometry works best for EEG foundation models?cited by 0
  33. 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Modelscited by 0
  34. 2026Best Practices in EEG Analysis: Preprocessing, Modeling, and Machine Learningcited by 0
  35. 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memorycited by 0
  36. 2026ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Modelscited by 0
  37. 2026Lightweight Semantic EEG Foundation Model for Frozen Cross-Disorder Transfercited by 0
  38. 2026SpecBraM: What Should an EEG Foundation Model Predict? Masked Band-Power Prediction versus Waveform Reconstructioncited by 0

50 most cited of 53 All 53 (JSON)