mlsanityData to 14 Oct 2026

Understanding and Correcting Low-Frequency Bias in EEG Foundation Model

arXiv 2608.01898 ↗First posted 3 Aug 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Increasing EEG pretraining data scale or model capacity does not consistently improve downstream performance. We identify a persistent low-frequency bias in representations learned by diverse EEG foundation models, which remains across dataset scales, model capacities, and pretraining objectives. Our analysis links this bias to the interaction between EEG's 1/fα-like spectral structure and neural networks' tendency to preferentially learn low-frequency components. In masked autoencoders, the ℓ2 reconstruction objective further amplifies this imbalance: under comparable relative reconstruction errors, high-power low-frequency components contribute disproportionately to the loss. To address this issue, we introduce FAME, a frequency-balanced masked autoencoding framework that reconstructs time--frequency activity in predefined EEG bands from masked EEG inputs. FAME independently standardizes the reconstruction targets within each band and assigns equal weight to all band-specific losses, thereby balancing supervision across the EEG spectrum. Evaluated on 41 downstream tasks in OmniEEG-Bench, FAME learns more spectrally balanced representations and achieves state-of-the-art performance on 24 of them. These results underscore the importance of balanced spectral supervision for learning transferable EEG representations.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 31 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

11 of 31 references.

References · 11

  1. 2018On the Spectral Bias of Neural Networkscited by 1,341
  2. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
  3. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  4. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
  5. 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
  6. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 74
  7. 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
  8. 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 62
  9. 2024EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classificationcited by 21
  10. 2026NeuralBench: A Unifying Framework to Benchmark NeuroAI Modelscited by 16
  11. 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.