mlsanityData to 14 Oct 2026

Brainprint-Modulated Target Speaker Extraction

arXiv 2509.17883 ↗First posted 22 Sep 2025cs.SD cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Achieving robust and personalized performance in neuro-steered Target Speaker Extraction (TSE) remains a significant challenge for next-generation hearing aids. This is primarily due to two factors: the inherent non-stationarity of EEG signals across sessions, and the high inter-subject variability that limits the efficacy of generalized models. To address these issues, we propose Brainprint-Modulated Target Speaker Extraction (BM-TSE), a novel framework for personalized and high-fidelity extraction. BM-TSE first employs a spatio-temporal EEG encoder with an Adaptive Spectral Gain (ASG) module to extract stable features resilient to non-stationarity. The core of our framework is a personalized modulation mechanism, where a unified brainmap embedding is learned under the joint supervision of subject identification (SID) and auditory attention decoding (AAD) tasks. This learned brainmap, encoding both static user traits and dynamic attentional states, actively refines the audio separation process, dynamically tailoring the output to each user. Evaluations on the public KUL and Cocktail Party datasets demonstrate that BM-TSE achieves state-of-the-art performance, significantly outperforming existing methods. Our code is publicly accessible at: https://github.com/rosshan-orz/BM-TSE.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 24 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

6 of 24 references.

References · 6

  1. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
  2. 2019Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separationcited by 182
  3. 2024DARNet: Dual Attention Refinement Network with Spatiotemporal Construction for Auditory Attention Detectioncited by 11
  4. 2021Sandglasset: A Light Multi-Granularity Self-attentive Network For Time-Domain Speech Separationcited by 10
  5. 2023NeuroHeed+: Improving Neuro-steered Speaker Extraction with Joint Auditory Attention Detectioncited by 6
  6. 2023BASEN: Time-Domain Brain-Assisted Speech Enhancement Network with Convolutional Cross Attention in Multi-talker Conditionscited by 4

Built on by

Not cited yet.