VoxCeleb2: Deep Speaker Recognition
Not on the map. Why?
Cited by 43 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The objective of this paper is speaker recognition under noisy and unconstrained conditions. We make two key contributions. First, we introduce a very large-scale audio-visual speaker recognition dataset collected from open-source media. Using a fully automated pipeline, we curate VoxCeleb2 which contains over a million utterances from over 6,000 speakers. This is several times larger than any publicly available speaker recognition dataset. Second, we develop and compare Convolutional Neural Network (CNN) models and training strategies that can effectively recognise identities from voice under various conditions. The models trained on the VoxCeleb2 dataset surpass the performance of previous works on a benchmark dataset by a significant margin.
Key facts. Cited by 875 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 122; 2022: 160; 2023: 163; 2024: 164; 2025: 147; 2026: 118.
875 papers.
Sort:
By area:
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 287
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
38 more
- 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 175
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
- 2021Textless Speech-to-Speech Translation on Real Datacited by 121
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 117
- 2021VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistencycited by 114
- 2023Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labelscited by 114
- 2022Generating Long Videos of Dynamic Scenescited by 113
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
- 2023Joint Audio and Speech Understandingcited by 100
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
- 2021One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learningcited by 87
- 2024Recent Advances in Speech Language Models: A Surveycited by 87
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 85
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2024The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speechcited by 83
- 2023Efficient Emotional Adaptation for Audio-Driven Talking-Head Generationcited by 81
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
- 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 75
- 2024Sonic: Shifting Focus to Global Audio Perception in Portrait Animationcited by 72
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 66
- 2022Audio Self-supervised Learning: A Surveycited by 65
- 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
50 most cited of 875 All 875 (JSON)
- 2026FASTDIAR: Frame-level speaker encoder for Streaming Diarization2 Oct 2026
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning30 Sep 2026
- 2026VOSSA: Voiceprint Optimization for Streaming Speech Architectures30 Sep 2026
- 2026InterBias-SV: Compound Conditions in Speaker Verification29 Sep 2026
- 2026Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy28 Sep 2026
- 2026Cross-modal Translation via Conditional Latent Denoising for Video Deepfake Detection27 Sep 2026
- 2026CoLMbo-SV: A Grounded Language Model for Explainable Speaker Verification27 Sep 2026
- 2026Improving Audiovisual Speech Recognition through Synthetic Visual Data Augmentation25 Sep 2026
- 2026Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction24 Sep 2026
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection24 Sep 2026
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval16 Sep 2026
38 more
- 2026SG-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement16 Sep 2026
- 2026Interpreting hierarchical organisation of speaker embeddings14 Sep 2026
- 2026A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset12 Sep 2026
- 2026Exploring Second-Order Pattern Recognition in Speaker Recognition10 Sep 2026
- 2026Candor-LR: A Dyadic Conversational Dataset for Audio-Visual Speech Recognition9 Sep 2026
- 2026AVSRBench: A Multi-Condition AVSR Benchmark9 Sep 2026
- 2026Attention-Guided Reliability Scaling for Contrastive Decoding in Robust Audio-Visual Speech Recognition26 Aug 2026
- 2026Combining Self-Embedding Audio Watermarking with Ultra-Low-Bitrate Neural Codecs26 Aug 2026
- 2026A Training-Free Proactive Defense Against Partial Speech Manipulation via Self-Embedding Steganography26 Aug 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Foundation Models are Implicit Deepfake Detectors10 Aug 2026
- 2026MERaLiON-GR: Speech Gender Recognition Model for English and SEA Languages5 Aug 2026
- 2026QR-Erase: Efficient Subspace-Based Machine Unlearning with Layer Localization2 Aug 2026
- 2026DoubleHelix: Structured Cross-Modal Fusion for Audio-Visual Speech Recognition with LLMs31 Jul 2026
- 2026Collaborative Feature Aggregation for Face Super-Resolution and Robust Re-Identification30 Jul 2026
- 2026Face and Voice Cross-modal Association with Learning Convex Feature Embedding30 Jul 2026
- 2026Ripple: Real-Time Streaming Audio-Video Generation With Cross-Modal Recurrent Memory29 Jul 2026
- 2026Zero-Shot Face-to-Speech Synthesis via Latent Space Adaptation of a Style-Diffusion TTS Model29 Jul 2026
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models28 Jul 2026
- 2026Beyond Short Segments : Expanding Speaker Embeddings with Vector Archives26 Jul 2026
- 2026OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars25 Jul 2026
- 2026Simple Language Normalization Wins: Cross-Lingual Speaker Verification for the TidyVoice 2026 Challenge24 Jul 2026
- 2026Do Speech Tokens Leak Voiceprints? Speaker Inversion Attacks Against End-to-End Speech Language Models18 Jul 2026
- 2026Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge15 Jul 2026
- 2026Reference-Based Face Super-Resolution Using the Spatial Transformer13 Jul 2026
- 2026VSRo-200: A Romanian Visual Speech Recognition Dataset for Studying Supervision and Multimodal Robustness9 Jul 2026
- 2026MG-RWKV: Multi-Grained Context-Aware RWKV for Temporal Forgery Localization1 Jul 2026
- 2026Sparsity-Inducing Divergence Losses for Biometric Verification30 Jun 2026
- 2026Reweighting Framewise Attention in Video Transformers for Facial Expression Understanding29 Jun 2026
- 2026Child-Centric Voice Anonymization in Single and Multi-Speaker Speech via Domain-Adapted SSL Models29 Jun 2026
- 2026AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification28 Jun 2026
- 2026DTI: Dynamic Trajectory Initialization for Generative Face Video Super-Resolution28 Jun 2026
- 2026TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration23 Jun 2026
- 2026VieSpeaker: A Large-Scale Vietnamese Speaker Recognition Dataset Beyond Visual Dependency23 Jun 2026
- 2026InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars22 Jun 2026
- 2026Explainable AI in Speaker Recognition -- Attention Map Visualisation and Evaluation22 Jun 2026
- 2026Kiwano: A Cutting-Edge Open-Source Toolkit for Speaker Verification21 Jun 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
50 newest of 875 All 875 (JSON)
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2024LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervisioncited by 56
- 2022Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priorscited by 55
- 2023Diff2Lip: Audio Conditioned Diffusion Models for Lip-Synchronizationcited by 49
- 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
- 2023DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for Verified Robust Voice Conversioncited by 38
- 2022Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Datacited by 35
- 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speechcited by 27
- 2024FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matchingcited by 23
- 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22
12 most cited of 43 All 43 (JSON)
- 2026OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars25 Jul 2026
- 2026DTI: Dynamic Trajectory Initialization for Generative Face Video Super-Resolution28 Jun 2026
- 2026Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization9 Jun 2026
- 2026HoliDubber: Holistic Video Dubbing for Complex Acoustic Scenes via Text-Guided Audio Synthesis8 Jun 2026
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs1 Jun 2026
- 2026IP-Adapter Is All You Need: Towards Fine-Tuning-Free Diffusion-Based Talking Face Generation28 May 2026
- 2026SLD-L2S: Hierarchical Subspace Latent Diffusion for High-Fidelity Lip to Speech Synthesis12 Feb 2026
- 2026ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors5 Jan 2026
- 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Model30 Nov 2025
- 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generation27 Nov 2025
- 2025See the Speaker: Crafting High-Resolution Talking Faces from Speech with Prior Guidance and Region Refinement28 Oct 2025
- 2025StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbing26 Sep 2025
12 newest of 43 All 43 (JSON)
- 2025Efficient and Robust Speaker Diarization via Structured Pruning of Self-Supervised Modelscited by 7
- 2023Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillationcited by 6
- 2021Voice activity detection in the wild: A data-driven approach using teacher-student trainingcited by 5
- 2024Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervisioncited by 5
- 2023One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verificationcited by 3
- 2025Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruningcited by 3
- 2021Class Token and Knowledge Distillation for Multi-head Self-Attention Speaker Verification Systemscited by 1
- 2024Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learningcited by 1
- 2025Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Modelscited by 1
- 2025Pushing the Frontiers of Self-Distillation Prototypes Network with Dimension Regularization and Score Normalizationcited by 1
- 2023Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervisioncited by 0
- 2026Triage knowledge distillation for speaker verificationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection13 Jun 2026
- 2026Triage knowledge distillation for speaker verification21 Jan 2026
- 2025Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruning5 Oct 2025
- 2025Efficient and Robust Speaker Diarization via Structured Pruning of Self-Supervised Models23 Jun 2025
- 2025Pushing the Frontiers of Self-Distillation Prototypes Network with Dimension Regularization and Score Normalization20 May 2025
- 2025Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models9 Feb 2025
- 2024Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision17 Jun 2024
- 2024Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learning3 Jan 2024
- 2023Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation6 Sep 2023
- 2023Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision5 Aug 2023
- 2023One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification27 May 2023
- 2021Class Token and Knowledge Distillation for Multi-head Self-Attention Speaker Verification Systems6 Nov 2021
12 newest of 13 All 13 (JSON)
- 2024Large Language Models are Strong Audio-Visual Speech Recognition Learnerscited by 42
- 2025ViSpeak: Visual Instruction Feedback in Streaming Videoscited by 42
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 20
- 2025See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Modelscited by 20
- 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processingcited by 8
- 2025AMUSE: Audio-Visual Benchmark and Alignment Framework for Agentic Multi-Speaker Understandingcited by 4
- 2026Why Do Vision Language Models Struggle To Recognize Human Emotions?cited by 1
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Modelscited by 0
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models28 Jul 2026
- 2026Why Do Vision Language Models Struggle To Recognize Human Emotions?16 Apr 2026
- 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processing14 Jan 2026
- 2025AMUSE: Audio-Visual Benchmark and Alignment Framework for Agentic Multi-Speaker Understanding18 Dec 2025
- 2025See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models1 Dec 2025
- 2025ViSpeak: Visual Instruction Feedback in Streaming Videos17 Mar 2025
- 2024Large Language Models are Strong Audio-Visual Speech Recognition Learners18 Sep 2024
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systemscited by 14
- 2026LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localizationcited by 4
- 2022Defend Data Poisoning Attacks on Voice Authenticationcited by 2
- 2024Clean Label Attacks against SLU Systemscited by 2
- 2025Where Do Backdoors Live? A Component-Level Analysis of Backdoor Propagation in Speech Language Modelscited by 1
- 2026QR-Erase: Efficient Subspace-Based Machine Unlearning with Layer Localizationcited by 0
- 2026QR-Erase: Efficient Subspace-Based Machine Unlearning with Layer Localization2 Aug 2026
- 2026LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localization27 Apr 2026
- 2025Where Do Backdoors Live? A Component-Level Analysis of Backdoor Propagation in Speech Language Models1 Oct 2025
- 2024Clean Label Attacks against SLU Systems13 Sep 2024
- 2023SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systems14 Sep 2023
- 2022Defend Data Poisoning Attacks on Voice Authentication9 Sep 2022
- 2025MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognitioncited by 4
- 2019MoEVC: A Mixture-of-experts Voice Conversion System with Sparse Gating Mechanism for Accelerating Online Computationcited by 0
- 2025Exploring Speaker Diarization with Mixture of Expertscited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Expertscited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verificationcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2025Exploring Speaker Diarization with Mixture of Experts17 Jun 2025
- 2025MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognition11 Feb 2025
- 2019MoEVC: A Mixture-of-experts Voice Conversion System with Sparse Gating Mechanism for Accelerating Online Computation27 Dec 2019
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 287
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
12 most cited of 793 All 793 (JSON)
- 2026FASTDIAR: Frame-level speaker encoder for Streaming Diarization2 Oct 2026
- 2026VOSSA: Voiceprint Optimization for Streaming Speech Architectures30 Sep 2026
- 2026InterBias-SV: Compound Conditions in Speaker Verification29 Sep 2026
- 2026Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy28 Sep 2026
- 2026Cross-modal Translation via Conditional Latent Denoising for Video Deepfake Detection27 Sep 2026
- 2026CoLMbo-SV: A Grounded Language Model for Explainable Speaker Verification27 Sep 2026
- 2026Improving Audiovisual Speech Recognition through Synthetic Visual Data Augmentation25 Sep 2026
- 2026Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction24 Sep 2026
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection24 Sep 2026
- 2026VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval16 Sep 2026
- 2026Interpreting hierarchical organisation of speaker embeddings14 Sep 2026
- 2026A New Transformer-Based Approach for Audio-Based Kinship Verification and a New Uncontrolled Mandarin Kinship Speech Dataset12 Sep 2026
12 newest of 793 All 793 (JSON)