mlsanityData to 14 Oct 2026

BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signals

arXiv 2505.18185 ↗First posted 18 May 2025eess.SP cs.LGcited by 27

Not on the map. Why?

Abstract (arXiv)

Electroencephalography (EEG) and magnetoencephalography (MEG) measure neural activity non-invasively by capturing electromagnetic fields generated by dendritic currents. Although rooted in the same biophysics, EEG and MEG exhibit distinct signal patterns, further complicated by variations in sensor configurations across modalities and recording devices. Existing approaches typically rely on separate, modality- and dataset-specific models, which limits the performance and cross-domain scalability. This paper proposes BrainOmni, the first brain foundation model that generalises across heterogeneous EEG and MEG recordings. To unify diverse data sources, we introduce BrainTokenizer,the first tokenizer that quantises spatiotemporal brain activity into discrete representations. Central to BrainTokenizer is a novel Sensor Encoder that encodes sensor properties such as spatial layout, orientation, and type, enabling compatibility across devices and modalities. Building upon the discrete representations, BrainOmni learns unified semantic embeddings of brain signals by self-supervised pretraining. To the best of our knowledge, it is the first foundation model to support both EEG and MEG signals, as well as the first to incorporate large-scale MEG pretraining. A total of 1,997 hours of EEG and 656 hours of MEG data are curated and standardised from publicly available sources for pretraining. Experiments show that BrainOmni outperforms both existing foundation models and state-of-the-art task-specific models on a range of downstream tasks. It also demonstrates strong generalisation to unseen EEG and MEG devices. Further analysis reveals that joint EEG-MEG (EMEG) training yields consistent improvements across both modalities. Code and checkpoints are publicly available at https://github.com/OpenTSLab/BrainOmni.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 20 of its 79 references that are in the map. First posted on arXiv 18 May 2025.

Builds on

20 of 79 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  5. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  6. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  7. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  8. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  9. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  10. 2022High Fidelity Neural Audio Compressioncited by 687
  11. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
  12. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
8 more
  1. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
  2. 2022Decoding speech perception from non-invasive brain recordingscited by 130
  3. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  4. 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 66
  5. 2022Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEGcited by 55
  6. 2020SEANet: A Multi-modal Speech Enhancement Networkcited by 37
  7. 2021Self-supervised EEG Representation Learning for Automatic Sleep Stagingcited by 32
  8. 2024BrainWave: A Brain Signal Foundation Model for Clinical Applicationscited by 26

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 25.

27 papers.

Sort:

By area:

  1. 2025Neural Codecs as Biosignal Tokenizerscited by 14
  2. 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 9
  3. 2026OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Modelscited by 8
  4. 2026MEG-XL: Data-Efficient Brain-to-Text via Long-Context Pre-Trainingcited by 7
  5. 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 7
  6. 2026Let EEG Models Learn EEGcited by 7
  7. 2025NeuroRVQ: Multi-Scale Biosignal Tokenization for Generative Foundation Modelscited by 6
  8. 2026LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scalecited by 5
  9. 2026Subject-Aware Multi-Granularity Alignment for Zero-Shot EEG-to-Image Retrievalcited by 4
  10. 2026BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learningcited by 4
  11. 2026Wearable Foundation Models Should Go Beyond Static Encoderscited by 3
  12. 2026Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Modelscited by 3
15 more
  1. 2026Brain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEGcited by 2
  2. 2026Cross-Subject Generalization in Decoding Perceived Speech from Non-Invasive Brain Recordingscited by 2
  3. 2026A Systematic Evaluation of Sample-Level Tokenization Strategies for MEG Foundation Modelscited by 1
  4. 2026Next-Token Prediction Learns Generalisable Representations of Sleep Physiologycited by 1
  5. 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysiscited by 1
  6. 2026Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyondcited by 1
  7. 2026Scaling Next-Brain-Token Prediction for MEGcited by 0
  8. 2026One Brain, Omni Modalities: Towards Unified Non-Invasive Brain Decoding with Large Language Modelscited by 0
  9. 2026STEP: Scientific Time-Series Encoder Pretraining via Cross-Domain Distillationcited by 0
  10. 2026BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Languagecited by 0
  11. 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understandingcited by 0
  12. 2026A Roadmap for MEG Foundation Modelscited by 0
  13. 2026Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blockscited by 0
  14. 2026The Visual Target Matters: Learning across the Visual Hierarchy for Brain-to-Image Retrievalcited by 0
  15. 2026GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learningcited by 0