mlsanityData to 14 Oct 2026

SPERA: Spherical Prior EEG Foundation Model with Geometry- and Frequency-Aware Latent Prediction

arXiv 2610.10571 ↗First posted 4 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Electroencephalography (EEG) provides a non-invasive measure of ongoing neural activity, but building general-purpose EEG models remains challenging due to the heterogeneity of subjects, devices, and electrode montages. Existing EEG foundation models predominantly rely on reconstruction-based objectives defined on the observed signal, which contains both neural and non-neural components. We introduce SPERA (Spherical Prior EEG Representation Architecture), an EEG foundation model that adopts the joint-embedding predictive architecture (JEPA) to predict in latent space. SPERA introduces a Legendre-polynomial spatial prior, incorporated into attention to encode varying scalp electrode geometries. Two further components adapt the model to EEG: factorized temporal and spatial attention interleaved with periodic full-attention blocks, and a relational spectral regularizer aligning latent similarity structure with spectral views. Pretrained on approximately 80,000 hours of EEG from 29,048 subjects across 106 datasets, SPERA achieves the highest average balanced accuracy across nine downstream tasks spanning clinical, cognitive, and BCI applications. SPERA further exhibits strong parameter efficiency under linear probing and robustness across varying recording conditions, suggesting its potential as a general-purpose backbone for diverse EEG analyses.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 161 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

31 of 161 references.

References · 31

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2020GLU Variants Improve Transformercited by 1,804
  7. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  8. 2021ViViT: A Video Vision Transformercited by 1,620
  9. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  10. 2019Relational Knowledge Distillationcited by 889
  11. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  12. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
19 more
  1. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  2. 2018Learning Deep Representations with Probabilistic Knowledge Transfercited by 213
  3. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  4. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 157
  5. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  6. 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
  7. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
  8. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
  9. 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
  10. 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 43
  11. 2020EEGdenoiseNet: A benchmark dataset for end-to-end deep learning solutions of EEG denoisingcited by 34
  12. 2021Self-supervised EEG Representation Learning for Automatic Sleep Stagingcited by 32
  13. 2025CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Modelcited by 28
  14. 20222021 BEETL Competition: Advancing Transfer Learning for Subject Independence & Heterogenous EEG Data Setscited by 23
  15. 2025Tokenizing Single-Channel EEG with Time-Frequency Motif Learningcited by 17
  16. 2024S-JEPA: towards seamless cross-dataset transfer through dynamic spatial attentioncited by 16
  17. 2025From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Saptiotemporal Dynamics in Brain Signal Analysiscited by 4
  18. 2026Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstructioncited by 4
  19. 2026LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modelingcited by 4

Built on by

Not cited yet.