mlsanityData to 19 Oct 2026

VoxTubeS: Distributable Speaker-Anonymized Synthetic Speech Corpora and Their Analysis

arXiv 2609.12432 ↗First posted 11 Sep 2026eess.AScited by 0

On the map: Speech and audio language models → Anti-spoofing and adversarial audio attacks

Abstract (arXiv)

Large speech corpora support research, but recordings can expose speaker identity because voice remains a recognizable biometric. Meanwhile, speech data derived from media can be difficult to redistribute reliably. We present VoxTubeS, a family of speaker-anonymized synthetic speech corpora designed for redistribution, comprising three method families and seven variants derived from the VoxTube corpus, which is distributed under CC BY-NC-SA 4.0, using 1.29M quality-filtered English utterances from 1,511 speakers. The synthesis methods span voice conversion, latent-space anonymization, and controllable text-to-speech. We evaluate VoxTubeS using utterance-level unlinkability, conversation-level linkability and singling-out, downstream speaker verification, linguistic consistency, speaker diversity, and fairness metrics for gender and accents. Our comprehensive analysis exposes a complex trade-off: stronger identity suppression often reduces linkability but sacrifices utility and population diversity, whereas speaker consistency training improves both utterance- and conversation-level privacy while retaining comparable utility and a broader speaker space. Fairness varies independently of aggregate performance. No method dominates; VoxTubeS therefore treats corpus construction as a choice among operating points that balances privacy, utility, diversity, fairness, and responsible redistribution under the source license.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Anti-spoofing and adversarial audio attacks, one of 11 directions in Speech and audio language models. Builds on 22 of its 29 references that are in the map. First posted on arXiv 11 Sep 2026.

Builds on

22 of 29 references.

References · 22

  1. 2022Classifier-Free Diffusion Guidancecited by 5,991
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,661
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,135
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,462
  5. 2018VoxCeleb2: Deep Speaker Recognitioncited by 1,166
  6. 2017VoxCeleb: a large-scale speaker identification datasetcited by 985
  7. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 980
  8. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 315
  9. 2024Open-Source Conversational AI with SpeechBrain 1.0cited by 68
  10. 2021The VoicePrivacy 2020 Challenge: Results and findingscited by 53
  11. 2024The VoicePrivacy 2024 Challenge Evaluation Plancited by 48
  12. 2022A Unified Framework for Quantifying Privacy Risk in Synthetic Datacited by 47
10 more
  1. 2023Speaker anonymization using orthogonal Householder neural networkcited by 21
  2. 2024The VoicePrivacy 2022 Challenge: Progress and Perspectives in Voice Anonymisationcited by 21
  3. 2020Deep Neural Networks for Automatic Speech Processing: A Survey from Large Corpora to Limited Datacited by 11
  4. 2026The Third VoicePrivacy Challenge: Preserving Emotional Expressiveness and Linguistic Content in Voice Anonymizationcited by 9
  5. 2023SynVox2: Towards a privacy-friendly VoxCeleb2 datasetcited by 7
  6. 2022Study on the Fairness of Speaker Verification Systems on Underrepresented Accents in Englishcited by 6
  7. 2022Hiding speaker's sex in speech using zero-evidence speaker representation in an analysis/synthesis pipelinecited by 4
  8. 2023Voice Anonymization for All -- Bias Evaluation of the Voice Privacy Challenge Baseline Systemcited by 3
  9. 2025DAIEN-TTS: Disentangled Audio Infilling for Environment-Aware Text-to-Speech Synthesiscited by 3
  10. 2023SALT: Distinguishable Speaker Anonymization Through Latent Space Transformationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VoxAnon: A balanced dataset for a fair evaluation of speech anonymization
  2. 2026Multimodal Speaker Verification as a Threat to Speaker Anonymization
  3. 2026Your Voice Cloning System is Secretly a Voice Anonymizer
  4. 2022Differentially Private Speaker Anonymization
  5. 2025VoxGuard: Evaluating User and Attribute Privacy in Speech via Membership Inference Attacks
  6. 2026NouveauVoice: Generating Novel Pseudo Speakers for Voice Anonymization
  7. 2022Distinguishable Speaker Anonymization based on Formant and Fundamental Frequency Scaling
  8. 2022Speaker Anonymization with Phonetic Intermediate Representations