Graph Adapter of EEG Foundation Models for Parameter Efficient Fine Tuning
Not on the map. Why?
Abstract (arXiv)
In diagnosing neurological disorders from electroencephalography (EEG) data, foundation models such as Transformers have been employed to capture temporal dynamics. Additionally, Graph Neural Networks (GNNs) are critical for representing the spatial relationships among EEG sensors. However, fine-tuning these large-scale models for both temporal and spatial features can be prohibitively large in computational cost, especially under the limited availability of labeled EEG datasets. We propose EEG-GraphAdapter (EGA), a parameter-efficient fine-tuning (PEFT) approach designed to address these challenges. EGA is integrated into a pre-trained temporal backbone model as a GNN-based module, freezing the backbone and allowing only the adapter to be fine-tuned. This enables the effective acquisition of EEG spatial representations, significantly reducing computational overhead and data requirements. Experimental evaluations on two healthcare-related downstream tasks-Major Depressive Disorder (MDD) and Abnormality Detection (TUAB)-show that EGA improves performance by up to 16.1% in F1-score compared with the backbone BENDR model, highlighting its potential for scalable and accurate EEG-based predictions.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 25 Nov 2024.
Builds on
17 of 26 references.
References · 17
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
- 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 132
- 2024Can GNN be Good Adapter for LLMs?cited by 71
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 70
- 2022MAEEG: Masked Auto-encoder for EEG Representation Learningcited by 61
- 2024EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputscited by 48
- 2021EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signalscited by 28
5 more
- 2024BrainWave: A Brain Signal Foundation Model for Clinical Applicationscited by 26
- 2023G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networkscited by 25
- 2020EEG-GCNN: Augmenting Electroencephalogram-based Neurological Disease Diagnosis using a Domain-guided Graph Convolutional Neural Networkcited by 18
- 2022mdx: A Cloud Platform for Supporting Data Science and Cross-Disciplinary Research Collaborationscited by 8
- 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applicationscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjectscited by 70
- 2026Cross-Subject Generalization for EEG Decoding: A Survey of Deep Learning Methodscited by 3
- 2026Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgetscited by 0
- 2026Lightweight Adaptation of EEG Foundation Models for Stroke Motor Imagery Decoding: Domain Shift and Subject-Level Robustnesscited by 0
- 2026Lightweight Adaptation of EEG Foundation Models for Stroke Motor Imagery Decoding: Domain Shift and Subject-Level Robustness31 Aug 2026
- 2026Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgets25 Aug 2026
- 2026Cross-Subject Generalization for EEG Decoding: A Survey of Deep Learning Methods29 Apr 2026
- 2025REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects24 Oct 2025