mlsanityData to 7 Oct 2026

VoiceExtender: Short-utterance Text-independent Speaker Verification with Guided Diffusion Model

arXiv 2310.04681 ↗First posted 7 Oct 2023cs.SD cs.AI eess.AScited by 2

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Speaker verification (SV) performance deteriorates as utterances become shorter. To this end, we propose a new architecture called VoiceExtender which provides a promising solution for improving SV performance when handling short-duration speech signals. We use two guided diffusion models, the built-in and the external speaker embedding (SE) guided diffusion model, both of which utilize a diffusion model-based sample generator that leverages SE guidance to augment the speech features based on a short utterance. Extensive experimental results on the VoxCeleb1 dataset show that our method outperforms the baseline, with relative improvements in equal error rate (EER) of 46.1%, 35.7%, 10.4%, and 5.7% for the short utterance conditions of 0.5, 1.0, 1.5, and 2.0 seconds, respectively.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 30 of its 42 references that are in the map. First posted on arXiv 7 Oct 2023.

Builds on

30 of 42 references.

Closest ancestors · 1

Same direction, newest first

  1. 2021Symbolic Music Generation with Diffusion Models30 Mar

Other references · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  11. 2022Video Diffusion Modelscited by 2,280
  12. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
17 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  4. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  5. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  6. 2017Generative Adversarial Networks: An Overviewcited by 588
  7. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  8. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
  9. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  10. 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
  11. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  12. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
  13. 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Modelscited by 63
  14. 2021RawNeXt: Speaker verification system for variable-duration utterances with deep layer aggregation and extended dynamic scaling policiescited by 6
  15. 2019A Deep Neural Network for Short-Segment Speaker Recognitioncited by 5
  16. 2018Short utterance compensation in speaker verification via cosine-based teacher-student learning of speaker embeddingscited by 3
  17. 2020Length- and Noise-aware Training Techniques for Short-utterance Speaker Recognitioncited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.

  1. 2024The last Dance : Robust backdoor attack via diffusion models and bayesian approachcited by 3
  2. 2024Character-aware audio-visual subtitling in contextcited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2025Unsupervised Single-Channel Speech Separation with Diffusion under Speaker-Embedding Guidance
  2. 2023Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separation
  3. 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance
  4. 2023Diff-SV: A Unified Hierarchical Framework for Noise-Robust Speaker Verification Using Score-Based Diffusion Probabilistic Models
  5. 2025MDD: a Mask Diffusion Detector to Protect Speaker Verification Systems from Adversarial Perturbations ↗
  6. 2025SEED: Speaker Embedding Enhancement Diffusion Model
  7. 2026DiffVQE2: An Efficient Low-delay Diffusion Model for Acoustic Echo and Noise Control
  8. 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding