mlsanityData to 14 Oct 2026

SpecBraM: What Should an EEG Foundation Model Predict? Masked Band-Power Prediction versus Waveform Reconstruction

arXiv 2610.07484 ↗First posted 5 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised EEG models often reconstruct masked waveforms or predict discrete codes. We study a task-aligned alternative: masked band-power prediction (MBP), which predicts fixed narrow-band log spectral energy for masked channel-time patches. This target retains rhythm power relevant to sleep staging while avoiding phase-sensitive waveform reconstruction and a learned codebook. Across three pretraining seeds, we compare band-power and waveform targets with matched backbones, pretraining data (2,388 hours), and training steps, including a 2x2 tokenizer-by-target design. On ISRUC and HMC sleep staging, MBP exceeds raw- and band-waveform reconstruction by 1.6-2.8 balanced-accuracy points with all labels and 4.7-7.3 points with 1% of labels under a strict linear probe; the target effect exceeds the tokenizer effect. Its frozen features reach 0.7916/0.7425 balanced accuracy, versus 0.7636/0.7227 for a matched rich handcrafted spectral baseline, although the gap is about one point with 1% of labels. Full fine-tuning reaches 0.8107/0.7669. The gains do not extend to every task with spectral cues, including motor imagery, depression screening, and vigilance regression. These results support choosing pretraining targets to match the physical quantities and spatial and temporal scales relevant to downstream labels.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 41 references that are in the map. First posted on arXiv 5 Oct 2026.

Builds on

10 of 41 references.

References · 10

  1. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  2. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  3. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  4. 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
  5. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  6. 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
  7. 2025BioSerenity-E1: a self-supervised EEG model for medical applicationscited by 4
  8. 2026BandVQ: Band-Wise Vector-Quantized EEG Foundation Modelcited by 1
  9. 2026Understanding and Correcting Low-Frequency Bias in EEG Foundation Modelcited by 1
  10. 2026MANAS-2: Constrained Reconstruction for EEG Foundation Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026What masking geometry works best for EEG foundation models?
  2. 2026SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding
  3. 2024BiT-MamSleep: Bidirectional Temporal Mamba for EEG Sleep Staging
  4. 2026Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models
  5. 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input
  6. 2026Next-Token Prediction Learns Generalisable Representations of Sleep Physiology
  7. 2025sDREAMER: Self-distilled Mixture-of-Modality-Experts Transformer for Automatic Sleep Staging
  8. 2026LightSleepX: A Lightweight, Inception-Based Dual-Modal Network for Sleep Staging