# A lightweight dual-stage framework for personalized speech enhancement based on DeepFilterNet2

arXiv: https://arxiv.org/abs/2404.08022 · HTML: https://mlsanity.com/paper/2404.08022/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Apr 2024.

## Built on by (most cited first, 1 of 1)

- [Contrastive Knowledge Distillation for Embedding Refinement in Personalized Speech Enhancement](https://mlsanity.com/paper/2601.16235/) (2026)

## Abstract (arXiv)

Isolating the desired speaker's voice amidst multiplespeakers in a noisy acoustic context is a challenging task. Per-sonalized speech enhancement (PSE) endeavours to achievethis by leveraging prior knowledge of the speaker's voice.Recent research efforts have yielded promising PSE mod-els, albeit often accompanied by computationally intensivearchitectures, unsuitable for resource-constrained embeddeddevices. In this paper, we introduce a novel method to per-sonalize a lightweight dual-stage Speech Enhancement (SE)model and implement it within DeepFilterNet2, a SE modelrenowned for its state-of-the-art performance. We seek anoptimal integration of speaker information within the model,exploring different positions for the integration of the speakerembeddings within the dual-stage enhancement architec-ture. We also investigate a tailored training strategy whenadapting DeepFilterNet2 to a PSE task. We show that ourpersonalization method greatly improves the performancesof DeepFilterNet2 while preserving minimal computationaloverhead.