Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blocks
Not on the map. Why?
Abstract (arXiv)
Effective EEG decoding requires representations that preserve organization among channels, local waveform dynamics, and long-range temporal context. Existing EEG architectures often capture these structures using separate specialized modules or collapse them into a single token sequence, making it difficult to maintain their distinct roles and coordinate their interactions throughout the backbone. We propose TriDim, a reusable block that preserves the representation shape and keeps three EEG axes explicit: channel, sample position within each patch, and patch position across the recording. These axes correspond to spatial, short-term temporal, and long-term temporal information, respectively. Each TriDim block applies feed-forward transformations along individual axes and cross-axis attention to coordinate information exchange among them. By stacking TriDim blocks with a multi-level tri-axis readout, we construct TriDimEEG, a standalone EEG decoder. Under strict cross-subject evaluation on eight datasets spanning clinical diagnosis, sleep staging, motor imagery, and emotion recognition, TriDimEEG achieves the best overall performance among fifteen evaluated models, with a 4.3% relative improvement in average accuracy over the second-best model. Replacing Transformer blocks in three EEG foundation models with TriDim blocks yields an average relative improvement of 7.4% in downstream accuracy while reducing parameter counts by 17.0% to 47.3%. These results establish TriDim as an effective and reusable building block and TriDimEEG as a strong standalone EEG decoder. Code and parameters of TriDimEEG are available at https://github.com/ncclab-sustech/TriDim_model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
19 of 39 references.
References · 19
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2016Deep Networks with Stochastic Depthcited by 979
- 2021Going deeper with Image Transformerscited by 764
- 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
- 2019Deep learning-based electroencephalography analysis: a systematic reviewcited by 156
- 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
- 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
7 more
- 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
- 2021TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognitioncited by 52
- 2025BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signalscited by 27
- 2024EEG-Deformer: A Dense Convolutional Transformer for Brain-computer Interfacescited by 26
- 2025FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Modelcited by 16
- 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 8
- 2026Decentralized Attention Fails Centralized Signals: Rethinking Transformers for Medical Time Seriescited by 5
Built on by
Not cited yet.