CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding
Not on the map. Why?
Abstract (arXiv)
Understanding and decoding brain activity from electroencephalography (EEG) signals is a fundamental challenge in neuroscience and AI, with applications in cognition, emotion recognition, diagnosis, and brain-computer interfaces. While recent EEG foundation models advance generalized decoding via unified architectures and large-scale pretraining, they adopt a scale-agnostic dense modeling paradigm inherited from NLP and vision. This design neglects a core property of neural activity: cross-scale spatiotemporal structure. EEG task patterns span a wide range of temporal and spatial scales, from short bursts to slow rhythms, and from localized cortical responses to distributed interactions. Ignoring this diversity leads to suboptimal representations and weak generalization. We propose CSBrain, a Cross-scale Spatiotemporal Brain foundation model for generalized EEG decoding. CSBrain introduces: (i) Cross-scale Spatiotemporal Tokenization (CST), which aggregates multi-scale features from localized temporal windows and anatomical brain regions into compact scale-aware tokens; and (ii) Structured Sparse Attention (SSA), which captures cross-window and cross-region dependencies, enhancing scale diversity while removing spurious correlations. CST and SSA are alternately stacked to progressively integrate multi-scale dependencies. Experiments on 11 EEG tasks across 16 datasets show that CSBrain consistently outperforms task-specific and foundation model baselines. These results establish cross-scale modeling as a key inductive bias and position CSBrain as a robust backbone for future brain-AI research.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 46 of its 119 references that are in the map. First posted on arXiv 29 Jun 2025.
Builds on
46 of 119 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Visual Instruction Tuningcited by 7,869
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2014Going Deeper with Convolutionscited by 4,241
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
34 more
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 527
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
- 2019EEG-Based Emotion Recognition Using Regularized Graph Neural Networkscited by 97
- 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
- 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
- 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 84
- 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
- 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
- 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
- 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 43
- 2022EEG based Emotion Recognition: A Tutorial and Reviewcited by 43
- 2020Inter-database validation of a deep learning approach for automatic sleep scoringcited by 38
- 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 34
- 2016A Multimodal Approach to Estimating Vigilance Using EEG and Forehead EOGcited by 33
- 2021Self-supervised EEG Representation Learning for Automatic Sleep Stagingcited by 32
- 2021EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signalscited by 28
- 2018ChronoNet: A Deep Recurrent Neural Network for Abnormal EEG Identificationcited by 27
- 2023Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learningcited by 27
- 2024BrainWave: A Brain Signal Foundation Model for Clinical Applicationscited by 26
- 2024Neuro-3D: Towards 3D Visual Decoding from EEG Signalscited by 23
- 2023Graph Neural Network-based EEG Classification: A Surveycited by 21
- 2025MindAligner: Explicit Brain Functional Alignment for Cross-Subject Visual Decoding from Limited fMRI Datacited by 18
- 2022Toward reliable signals decoding for electroencephalogram: A benchmark study to EEGNeXcited by 17
- 2023Generalizable Sleep Staging via Multi-Level Domain Alignmentcited by 17
- 2024Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognitioncited by 17
- 2025UniMind: Unleashing the Power of LLMs for Unified Multi-Task Brain Decodingcited by 14
- 2025A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectivescited by 10
- 2024Graph Neural Networks in EEG-based Emotion Recognition: A Surveycited by 6
- 2023GNN4EEG: A Benchmark and Toolkit for Electroencephalography Classification with Graph Neural Networkcited by 4
Built on by
Citing papers per year: 2025: 10; 2026: 43.
53 papers.
Sort:
By area:
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2025EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Modelscited by 23
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
- 2025Neural Codecs as Biosignal Tokenizerscited by 14
- 2025Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learningcited by 10
- 2025SynBrain: Enhancing Visual-to-fMRI Synthesis via Probabilistic Representation Learningcited by 9
- 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 9
- 2025ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Modelscited by 7
- 2026Let EEG Models Learn EEGcited by 7
- 2025MIRepNet: A Pipeline and Foundation Model for EEG-Based Motor Imagery Classificationcited by 5
- 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelinescited by 4
- 2025SingLEM: Single-Channel Large EEG Modelcited by 3
38 more
- 2026What Do EEG Foundation Models Capture from Human Brain Signals?cited by 3
- 2026Brain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEGcited by 2
- 2026Same Brain, Different Prediction: How Preprocessing Choices Undermine EEG Decoding Reliabilitycited by 2
- 2026KAST-BAR: Knowledge-Anchored Semantically-Dynamic Topology Brain Autoregressive Modeling for Universal Neural Interpretationcited by 2
- 2026SCOPE: Structured Prototype-Guided Adaptation for EEG Foundation Models with Limited Labelscited by 1
- 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decodingcited by 1
- 2026CLEF: EEG Foundation Model for Learning Clinical Semanticscited by 1
- 2026A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Modelscited by 1
- 2026MANAS-2: Constrained Reconstruction for EEG Foundation Modelscited by 1
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
- 2025Fusion of Multiscale Features Via Centralized Sparse-attention Network for EEG Decodingcited by 0
- 2026NeuroFlow: Toward Unified Visual Encoding and Decoding from Neural Activitycited by 0
- 2026A Multimodal Pre-trained Network for Integrated EEG-Video Seizure Detectioncited by 0
- 2026MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognitioncited by 0
- 2026Context-aware tokenization for Cross-subject Emotion Decoding from EEGcited by 0
- 2026EvoBrain: Continual Learning of EEG Foundation Models Across Heterogeneous BCI Taskscited by 0
- 2026Channel-Preserving Representation Alignment for EEG-to-Music Reconstructioncited by 0
- 2026RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learningcited by 0
- 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNetcited by 0
- 2026SPOTR: Spatio-temporal Pooling One-Token Reconstruction for Universal Physiological Signal Self-supervised Learningcited by 0
- 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decodingcited by 0
- 2026STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decodingcited by 0
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understandingcited by 0
- 2026Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Modelscited by 0
- 2026Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health taskscited by 0
- 2026EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstructioncited by 0
- 2026Adaptive Anisotropic Attention for Axis-Structured Signalscited by 0
- 2026BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classificationcited by 0
- 2026Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blockscited by 0
- 2026Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Modelscited by 0
- 2026RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEGcited by 0
- 2026What masking geometry works best for EEG foundation models?cited by 0
- 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Modelscited by 0
- 2026Best Practices in EEG Analysis: Preprocessing, Modeling, and Machine Learningcited by 0
- 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memorycited by 0
- 2026ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Modelscited by 0
- 2026Lightweight Semantic EEG Foundation Model for Frozen Cross-Disorder Transfercited by 0
- 2026SpecBraM: What Should an EEG Foundation Model Predict? Masked Band-Power Prediction versus Waveform Reconstructioncited by 0
50 most cited of 53 All 53 (JSON)
- 2026HyBRA-EEG: Hyperbolic Global-Local Brain-Region Aggregation for Self-Supervised EEG Representation Learning12 Oct 2026
- 2026DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models10 Oct 2026
- 2026SpecBraM: What Should an EEG Foundation Model Predict? Masked Band-Power Prediction versus Waveform Reconstruction5 Oct 2026
- 2026SPERA: Spherical Prior EEG Foundation Model with Geometry- and Frequency-Aware Latent Prediction4 Oct 2026
- 2026Lightweight Semantic EEG Foundation Model for Frozen Cross-Disorder Transfer4 Oct 2026
- 2026ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Models2 Oct 2026
- 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memory29 Sep 2026
- 2026Best Practices in EEG Analysis: Preprocessing, Modeling, and Machine Learning29 Sep 2026
- 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Models28 Sep 2026
- 2026What masking geometry works best for EEG foundation models?27 Sep 2026
- 2026Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models25 Sep 2026
- 2026RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG19 Sep 2026
38 more
- 2026Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blocks17 Sep 2026
- 2026MANAS-2: Constrained Reconstruction for EEG Foundation Models12 Sep 2026
- 2026BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classification10 Sep 2026
- 2026Adaptive Anisotropic Attention for Axis-Structured Signals8 Sep 2026
- 2026EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstruction1 Sep 2026
- 2026Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health tasks25 Aug 2026
- 2026Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models12 Aug 2026
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding4 Aug 2026
- 2026STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding3 Aug 2026
- 2026CoCoT-EEG: Contrastive-Pretrained Multiscale Convolutional Transformer for EEG Decoding10 Jul 2026
- 2026SPOTR: Spatio-temporal Pooling One-Token Reconstruction for Universal Physiological Signal Self-supervised Learning20 Jun 2026
- 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNet18 Jun 2026
- 2026RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learning13 Jun 2026
- 2026Channel-Preserving Representation Alignment for EEG-to-Music Reconstruction2 Jun 2026
- 2026EvoBrain: Continual Learning of EEG Foundation Models Across Heterogeneous BCI Tasks1 Jun 2026
- 2026Context-aware tokenization for Cross-subject Emotion Decoding from EEG30 May 2026
- 2026A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models27 May 2026
- 2026MSCGC-KAN: Multi-scale Causal Graph Convolution and KAN-inspired Analytic-basis Mapping for EEG Emotion Recognition26 May 2026
- 2026Let EEG Models Learn EEG20 May 2026
- 2026KAST-BAR: Knowledge-Anchored Semantically-Dynamic Topology Brain Autoregressive Modeling for Universal Neural Interpretation13 May 2026
- 2026What Do EEG Foundation Models Capture from Human Brain Signals?12 May 2026
- 2026CLEF: EEG Foundation Model for Learning Clinical Semantics11 May 2026
- 2026Same Brain, Different Prediction: How Preprocessing Choices Undermine EEG Decoding Reliability8 May 2026
- 2026A Multimodal Pre-trained Network for Integrated EEG-Video Seizure Detection29 Apr 2026
- 2026NeuroFlow: Toward Unified Visual Encoding and Decoding from Neural Activity10 Apr 2026
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discovery7 Apr 2026
- 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding17 Mar 2026
- 2026Brain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEG26 Feb 2026
- 2026SCOPE: Structured Prototype-Guided Adaptation for EEG Foundation Models with Limited Labels19 Feb 2026
- 2026NeuroWeaver: An Autonomous Evolutionary Agent for Exploring the Programmatic Space of EEG Analysis Pipelines13 Feb 2026
- 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCI5 Jan 2026
- 2025Fusion of Multiscale Features Via Centralized Sparse-attention Network for EEG Decoding21 Dec 2025
- 2025Neural Codecs as Biosignal Tokenizers10 Oct 2025
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEG9 Oct 2025
- 2025Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learning29 Sep 2025
- 2025ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Models26 Sep 2025
- 2025SingLEM: Single-Channel Large EEG Model22 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
50 newest of 53 All 53 (JSON)
- 2025EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Modelscited by 23
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
- 2025Neural Codecs as Biosignal Tokenizerscited by 14
- 2025Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learningcited by 10
- 2025SynBrain: Enhancing Visual-to-fMRI Synthesis via Probabilistic Representation Learningcited by 9
- 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 9
- 2025ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Modelscited by 7
- 2026Let EEG Models Learn EEGcited by 7
- 2025MIRepNet: A Pipeline and Foundation Model for EEG-Based Motor Imagery Classificationcited by 5
- 2025SingLEM: Single-Channel Large EEG Modelcited by 3
- 2026What Do EEG Foundation Models Capture from Human Brain Signals?cited by 3
- 2026Brain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEGcited by 2
12 most cited of 48 All 48 (JSON)
- 2026HyBRA-EEG: Hyperbolic Global-Local Brain-Region Aggregation for Self-Supervised EEG Representation Learning12 Oct 2026
- 2026DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models10 Oct 2026
- 2026SpecBraM: What Should an EEG Foundation Model Predict? Masked Band-Power Prediction versus Waveform Reconstruction5 Oct 2026
- 2026SPERA: Spherical Prior EEG Foundation Model with Geometry- and Frequency-Aware Latent Prediction4 Oct 2026
- 2026Lightweight Semantic EEG Foundation Model for Frozen Cross-Disorder Transfer4 Oct 2026
- 2026ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Models2 Oct 2026
- 2026NeurDuo-EEG: A Long-Sequence EEG Foundation Model with Persistent State and Explicit Memory29 Sep 2026
- 2026Best Practices in EEG Analysis: Preprocessing, Modeling, and Machine Learning29 Sep 2026
- 2026Representational and Functional Robustness to Electrode Montages in EEG Foundation Models28 Sep 2026
- 2026What masking geometry works best for EEG foundation models?27 Sep 2026
- 2026Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models25 Sep 2026
- 2026RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG19 Sep 2026
12 newest of 48 All 48 (JSON)