Bridging Brain with Foundation Models through Self-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These advances present a transformative opportunity for brain signal analysis. Unlike traditional supervised learning, which is limited by the scarcity of labeled neural data, SSL offers a promising solution by enabling models to learn meaningful representations from unlabeled data. This is particularly valuable in addressing the unique challenges of brain signals, including high noise levels, inter-subject variability, and low signal-to-noise ratios. This survey systematically reviews the emerging field of bridging brain signals with foundation models through the innovative application of SSL. It explores key SSL techniques, the development of brain-specific foundation models, their adaptation to downstream tasks, and the integration of brain signals with other modalities in multimodal SSL frameworks. The review also covers commonly used evaluation metrics and benchmark datasets that support comparative analysis. Finally, it highlights key challenges and outlines future research directions. This work aims to provide researchers with a structured understanding of this rapidly evolving field and a roadmap for developing generalizable brain foundation models powered by self-supervision.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 83 of its 143 references that are in the map. First posted on arXiv 19 Jun 2025.
Builds on
83 of 143 references.
References · 83
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
38 more
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2016Colorful Image Colorizationcited by 1,113
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2023A Cookbook of Self-Supervised Learningcited by 248
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
- 2022Decoding speech perception from non-invasive brain recordingscited by 129
- 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
- 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 83
- 2018MOABB: Trustworthy algorithm benchmarking for BCIscited by 80
- 2023Decoding Natural Images from EEG for Object Recognitioncited by 79
- 2024Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusioncited by 79
- 2016Deep Learning Human Mind for Automated Visual Classificationcited by 76
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 70
- 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 69
- 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 64
- 2022Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Featurescited by 63
- 2022Cross-modal Contrastive Learning for Speech Translationcited by 61
- 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 61
- 2018Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Featurescited by 52
- 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 51
- 2023Learning from models beyond fine-tuningcited by 47
- 2023DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translationcited by 36
- 2024BrainSegFounder: Towards 3D Foundation Models for Neuroimage Segmentationcited by 36
- 2024Are EEG-to-Text Models Working?cited by 32
- 2023ViT-Lens: Towards Omni-modal Representationscited by 29
50 most cited of 83 All 83 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.