DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models
Not on the map. Why?
Abstract (arXiv)
EEG foundation models (EFMs) have improved EEG representation learning by transferring knowledge from large-scale multi-subject pretraining to downstream tasks. However, their pretrained embeddings often retain substantial subject-related variation, placing an additional burden on the downstream classifier, especially in cross-subject settings. To address this issue, we propose Disentangled EFM Fine-Tuning (DEFT), a plug-and-play adapter for EFM fine-tuning. DEFT encourages branch disentanglement of pretrained tokens into task-oriented content and subject-consistent style, then performs downstream prediction from the content branch. It instantiates this factorize-before-classify design with recursive Gaussian refinement, temporal-variance regularization, subject-aware contrastive learning, and reconstruction. Experiments across multiple EEG datasets and four EFM backbones show that DEFT improves matched fine-tuning baselines. Further ablations and analyses support the intended content/style branch organization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
34 of 69 references.
References · 34
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 327
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 199
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 199
- 2018Disentangled Sequential Autoencodercited by 120
- 2017Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Datacited by 93
- 2024NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signalscited by 88
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 80
- 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 62
22 more
- 2021Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognitioncited by 60
- 2020Transfer Learning for EEG-Based Brain-Computer Interfaces: A Review of Progress Made Since 2016cited by 59
- 2025CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decodingcited by 53
- 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 50
- 2025CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Modelcited by 28
- 2024EEG-Deformer: A Dense Convolutional Transformer for Brain-computer Interfacescited by 26
- 2024EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classificationcited by 21
- 2025Tokenizing Single-Channel EEG with Time-Frequency Motif Learningcited by 17
- 2019Adversarial Representation Learning for Robust Patient-Independent Epileptic Seizure Detectioncited by 14
- 2025UniMind: Unleashing the Power of LLMs for Unified Multi-Task Brain Decodingcited by 14
- 2023Disentangling Voice and Content with Self-Supervision for Speaker Recognitioncited by 13
- 2025NeurIPT: Foundation Model for Neural Interfacescited by 11
- 2025Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learningcited by 10
- 2021Xi-Vector Embedding for Speaker Recognitioncited by 9
- 2026DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCIcited by 9
- 2025ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG Modelscited by 7
- 2024BiT-MamSleep: Bidirectional Temporal Mamba for EEG Sleep Stagingcited by 5
- 2026BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregressioncited by 5
- 2024A Comprehensive Survey on EEG-Based Emotion Recognition: A Graph-Based Perspectivecited by 4
- 2025DIVER-0 : A Fully Channel Equivariant EEG Foundation Modelcited by 2
- 2025BrainPro: Towards Large-scale Brain State-aware EEG Representation Learningcited by 2
- 2025Introducing Multimodal Paradigm for Learning Sleep Staging PSG via General-Purpose Modelcited by 1
Built on by
Not cited yet.