mlsanityData to 7 Oct 2026

STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding

arXiv 2608.02070 ↗First posted 3 Aug 2026cs.CV cs.LGcited by 0

On the map: Mixture-of-experts → Medical and biomedical MoE

Abstract (arXiv)

Brain-computer interfaces (BCIs) have been widely used in motor rehabilitation, disease diagnosis, and other neural engineering scenarios. However, conventional neural signal decoding algorithms often suffer from limited generalizability and high adaptation costs, motivating recent interest in BCI foundation models. Existing approaches still struggle to jointly achieve general transferability, accurate decoding, and efficient downstream adaptation. We present STEAM, a hierarchical transfer framework that reconciles general-purpose representation learning with paradigm-specific specialization in EEG foundation models. The framework is instantiated as a dual-branch spatio-temporal encoder in which a shared soft mixture-of-experts (SSMoE) module aligns the spatial and temporal branches, allowing complementary representations to exchange information through a compact set of soft slots. Across seven downstream datasets and fourteen evaluation settings, STEAM attains the best average rank among the compared methods at a competitive inference cost measured in FLOPs. Building upon the Stage-I general initialization, the hierarchical pre-training strategy further specializes the model to a target paradigm without retraining from scratch, yielding consistent gains in paradigm-specific decoding accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 14 of its 47 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

14 of 47 references.

References · 14

  1. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  3. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  4. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
  5. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
  6. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
  7. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 83
  8. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 69
  9. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 54
  10. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 46
  11. 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 38
  12. 2016A Multimodal Approach to Estimating Vigilance Using EEG and Forehead EOGcited by 32
2 more
  1. 2025DBConformer: Dual-Branch Convolutional Transformer for EEG Decodingcited by 11
  2. 2025Spatial Distillation based Distribution Alignment (SDDA) for Cross-Headset EEG Classificationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding
  2. 2026BrainStack: Neuro-MoE with Functionally Guided Expert Routing for EEG-Based Language Decoding
  3. 2026EEG-Fusion: Failure-Informed Source-Free Expert Routing for Robust Motor Imagery EEG Decoding
  4. 2025GCMCG: A Clustering-Aware Graph Attention and Expert Fusion Network for Multi-Paradigm, Multi-task, and Cross-Subject EEG Decoding
  5. 2024BELT-2: Bootstrapping EEG-to-Language representation alignment for multi-task brain decoding
  6. 2025Cortical-SSM: A Deep State Space Model for Motor Imagery Decoding from EEG Signals
  7. 2026B[FM]2: Brain Foundation Model via Flow Matching with SplitUNet
  8. 2026Multimodal LLMs Can Learn to Read Brain Signals: A Vision--Language Model for Unified Multi-Task EEG Decoding