mlsanityData to 14 Oct 2026

VoxCeleb: a large-scale speaker identification dataset

arXiv 1706.08612 ↗First posted 26 Jun 2017cs.SDcited by 732

Not on the map. Why?

Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Most existing datasets for speaker identification contain samples obtained under quite constrained conditions, and are usually hand-annotated, hence limited in size. The goal of this paper is to generate a large scale text-independent speaker identification dataset collected 'in the wild'. We make two contributions. First, we propose a fully automated pipeline based on computer vision techniques to create the dataset from open-source media. Our pipeline involves obtaining videos from YouTube; performing active speaker verification using a two-stream synchronization Convolutional Neural Network (CNN), and confirming the identity of the speaker using CNN based facial recognition. We use this pipeline to curate VoxCeleb which contains hundreds of thousands of 'real world' utterances for over 1,000 celebrities. Our second contribution is to apply and compare various state of the art speaker identification techniques on our dataset to establish baseline performance. We show that a CNN based architecture obtains the best performance for both identification and verification.

Key facts. Cited by 732 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Jun 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 128; 2022: 137; 2023: 138; 2024: 149; 2025: 91; 2026: 89.

732 papers.

Sort:

By area:

  1. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  2. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  3. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  4. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
  5. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  6. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 288
  7. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
  8. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
  9. 2021Motion Representations for Articulated Animationcited by 255
  10. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
  11. 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
  12. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
38 more
  1. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
  2. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
  3. 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
  4. 2021SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processingcited by 180
  5. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 178
  6. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
  7. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  8. 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 163
  9. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
  10. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 149
  11. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
  12. 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 128
  13. 2021VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistencycited by 114
  14. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  15. 2024WavLLM: Towards Robust and Adaptive Speech Large Language Modelcited by 109
  16. 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
  17. 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
  18. 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
  19. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
  20. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 91
  21. 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
  22. 2021BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognitioncited by 88
  23. 2021One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learningcited by 87
  24. 2024Recent Advances in Speech Language Models: A Surveycited by 87
  25. 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 83
  26. 2021A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understandingcited by 82
  27. 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
  28. 2021SLUE: New Benchmark Tasks for Spoken Language Understanding Evaluation on Natural Speechcited by 72
  29. 2021LEAF: A Learnable Frontend for Audio Classificationcited by 69
  30. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  31. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  32. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
  33. 2024AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encodingcited by 67
  34. 2022Audio Self-supervised Learning: A Surveycited by 65
  35. 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 63
  36. 2023Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generationcited by 61
  37. 2022Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priorscited by 55
  38. 20223D GAN Inversion for Controllable Portrait Image Animationcited by 53

50 most cited of 732 All 732 (JSON)