mlsanityData to 14 Oct 2026

Brain-Token Learning: Microstate-Based Tokenization and Multi-Scale Interaction for Long-Horizon EEG Sequence Modeling

arXiv 2609.24324 ↗First posted 21 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Electroencephalography (EEG) provides a non-invasive window into dynamic brain activity, yet modeling long-horizon EEG sequences remains challenging due to their high temporal complexity, substantial variability across subjects, and the lack of biologically meaningful sequence representations. Existing tokenization strategies, such as fixed-window and patch-based representations, discretize EEG signals according to artificial temporal boundaries, which may disrupt intrinsic brain-state dynamics. In this work, we propose Brain-Token Learning, a neuroscience-inspired framework that introduces Brain Tokenization for long-horizon EEG sequence modeling. Instead of partitioning EEG signals into predefined temporal segments, Brain Tokenization represents EEG as sequences of recurrent microstate-derived brain tokens, where each token corresponds to a quasi-stable large-scale brain state with variable temporal duration. Based on these biologically grounded tokens, we further develop a multi-scale token interaction module consisting of Latent State Aggregation and State Transition Modeling to jointly capture global brain-state context and local microstate transitions. We evaluate Brain-Token on five heterogeneous EEG datasets, including the newly collected long-horizon NeuroLong dataset and four affective or clinical EEG datasets (SEED, DEAP, MDD, and NSSI). Extensive experiments demonstrate that Brain-Token consistently outperforms conventional CNN/LSTM architectures, Transformer-based models, and domain adaptation methods across diverse EEG scenarios. Further analysis verifies the effectiveness of microstate-based tokenization and multi-scale interaction for learning robust and interpretable EEG representations. These results establish Brain-Token as a biologically grounded tokenization paradigm for long-horizon EEG sequence modeling.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 84 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

35 of 84 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2017Neural Discrete Representation Learningcited by 4,712
  10. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  11. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  12. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
23 more
  1. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  2. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  3. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  10. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
  11. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  12. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  13. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  14. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  15. 2022High Fidelity Neural Audio Compressioncited by 687
  16. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  17. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  18. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  19. 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
  20. 2019EEG-Based Emotion Recognition Using Regularized Graph Neural Networkscited by 97
  21. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  22. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  23. 2015Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networkscited by 45

Built on by

Not cited yet.