DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection
On the map: Knowledge distillation → Distillation for medical imaging
Abstract (arXiv)
Auditory Attention Detection (AAD) aims to detect target speaker from brain signals in a multi-speaker environment. Although EEG-based AAD methods have shown promising results in recent years, current approaches primarily rely on traditional convolutional neural network designed for processing Euclidean data like images. This makes it challenging to handle EEG signals, which possess non-Euclidean characteristics. In order to address this problem, this paper proposes a dynamical graph self-distillation (DGSD) approach for AAD, which does not require speech stimuli as input. Specifically, to effectively represent the non-Euclidean properties of EEG signals, dynamical graph convolutional networks are applied to represent the graph structure of EEG signals, which can also extract crucial features related to auditory spatial attention in EEG signals. In addition, to further improve AAD detection performance, self-distillation, consisting of feature distillation and hierarchical distillation strategies at each layer, is integrated. These strategies leverage features and classification results from the deepest network layers to guide the learning of shallow layers. Our experiments are conducted on two publicly available datasets, KUL and DTU. Under a 1-second time window, we achieve results of 90.0% and 79.6% accuracy on KUL and DTU, respectively. We compare our DGSD method with competitive baselines, and the experimental results indicate that the detection performance of our proposed DGSD method is not only superior to the best reproducible baseline but also significantly reduces the number of trainable parameters by approximately 100 times.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 14 of its 80 references that are in the map. First posted on arXiv 7 Sep 2023.
Builds on
14 of 80 references.
References · 14
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 401
- 2020EEG-based Auditory Attention Decoding: Towards Neuro-Steered Hearing Devicescited by 20
- 2023Learning From Yourself: A Self-Distillation Method for Fake Speech Detectioncited by 13
- 2023Relating EEG to continuous speech using deep neural networks: a reviewcited by 12
- 2017Robust Spatial Filtering with Graph Convolutional Neural Networkscited by 11
- 2016EEG-informed attended speaker extraction from recorded speech mixtures with application in neuro-steered hearing prosthesescited by 6
- 2021Extracting the Auditory Attention in a Dual-Speaker Scenario from EEG using a Joint CNN-LSTM Modelcited by 5
- 2021Low-latency auditory spatial attention detection based on spectro-spatial features from EEGcited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026RAMamba-Net: A Reliability-Aware and Mamba-Based Multimodal Fusion Network for Auditory Attention Detection
- 2026NEUROTOKEN: Joint Source and Directional AAD with Envelope Decoding via Conditional Flow Matching
- 2024SWIM: Short-Window CNN Integrated with Mamba for EEG-Based Auditory Spatial Attention Decoding
- 2025Improved Feature Extraction Network for Neuro-Oriented Target Speaker Extraction
- 2025GCMCG: A Clustering-Aware Graph Attention and Expert Fusion Network for Multi-Paradigm, Multi-task, and Cross-Subject EEG Decoding
- 2024Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG
- 2026A Resource-Efficient CNN-Based EEG Auditory Attention Decoding ASIC ↗
- 2026Addressing Limited Data in Auditory Attention Decoding with Diffusion Generative Models