VoxBlink2: A 100K+ Speaker Recognition Corpus and the Open-Set Speaker-Identification Benchmark
Not on the map. Why?
Abstract (arXiv)
In this paper, we provide a large audio-visual speaker recognition dataset, VoxBlink2, which includes approximately 10M utterances with videos from 110K+ speakers in the wild. This dataset represents a significant expansion over the VoxBlink dataset, encompassing a broader diversity of speakers and scenarios by the grace of an optimized data collection pipeline. Afterward, we explore the impact of training strategies, data scale, and model complexity on speaker verification and finally establish a new single-model state-of-the-art EER at 0.170% and minDCF at 0.006% on the VoxCeleb1-O test set. Such remarkable results motivate us to explore speaker recognition from a new challenging perspective. We raise the Open-Set Speaker-Identification task, which is designed to either match a probe utterance with a known gallery speaker or categorize it as an unknown query. Associated with this task, we design concrete benchmark and evaluation protocols. The data and model resources can be found in http://voxblink2.github.io.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jul 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 2; 2025: 8; 2026: 14.
24 papers.
Sort:
By area:
- 2025The First VoicePrivacy Attacker Challengecited by 4
- 2025The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognitioncited by 4
- 2024Holistic Uncertainty Estimation For Open-Set Recognitioncited by 3
- 2025FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for "U-Tsang, Amdo and Kham Speech Dataset Generationcited by 3
- 2026Scores Know Bobs Voice: Speaker Impersonation Attackcited by 2
- 2025Interpolating Speaker Identities in Embedding Space for Data Expansioncited by 1
- 2025DELULU: Discriminative Embedding Learning Using Latent Units for Speaker-Aware Self-Trained Speech Foundational Modelcited by 1
- 2026What and When to Learn: CURriculum Ranking Loss for Large-Scale Speaker Verificationcited by 1
- 2026POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plancited by 1
- 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognitioncited by 1
- 2026AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identificationcited by 1
- 2024The First VoicePrivacy Attacker Challenge Evaluation Plancited by 0
12 more
- 2025Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Modelscited by 0
- 2025Comparison of End-to-end Speech Assessment Models for the NOCASA 2025 Challengecited by 0
- 2025Adaptive Multimodal Person Recognition: A Robust Framework for Handling Missing Modalitiescited by 0
- 2026Self-Supervised Learning for Speaker Recognition: A study and reviewcited by 0
- 2026Uncertainty Estimation for the Open-Set Text Classification systemscited by 0
- 2026L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verificationcited by 0
- 2026ZONOS2 Technical Reportcited by 0
- 2026Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challengecited by 0
- 2026Simple Language Normalization Wins: Cross-Lingual Speaker Verification for the TidyVoice 2026 Challengecited by 0
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challengecited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verificationcited by 0
- 2026Mixed-Prior Decision Risk for Open-Set Recognitioncited by 0
- 2026Mixed-Prior Decision Risk for Open-Set Recognition28 Sep 2026
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Simple Language Normalization Wins: Cross-Lingual Speaker Verification for the TidyVoice 2026 Challenge24 Jul 2026
- 2026Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge15 Jul 2026
- 2026AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification28 Jun 2026
- 2026ZONOS2 Technical Report23 Jun 2026
- 2026L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification16 Jun 2026
- 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognition4 Jun 2026
- 2026POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan25 Mar 2026
- 2026What and When to Learn: CURriculum Ranking Loss for Large-Scale Speaker Verification25 Mar 2026
- 2026Uncertainty Estimation for the Open-Set Text Classification systems17 Mar 2026
12 more
- 2026Scores Know Bobs Voice: Speaker Impersonation Attack3 Mar 2026
- 2026Self-Supervised Learning for Speaker Recognition: A study and review11 Feb 2026
- 2025Adaptive Multimodal Person Recognition: A Robust Framework for Handling Missing Modalities16 Dec 2025
- 2025DELULU: Discriminative Embedding Learning Using Latent Units for Speaker-Aware Self-Trained Speech Foundational Model20 Oct 2025
- 2025Comparison of End-to-end Speech Assessment Models for the NOCASA 2025 Challenge3 Sep 2025
- 2025Interpolating Speaker Identities in Embedding Space for Data Expansion26 Aug 2025
- 2025Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models16 Jun 2025
- 2025FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for "U-Tsang, Amdo and Kham Speech Dataset Generation20 May 2025
- 2025The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition20 May 2025
- 2025The First VoicePrivacy Attacker Challenge19 Apr 2025
- 2024The First VoicePrivacy Attacker Challenge Evaluation Plan9 Oct 2024
- 2024Holistic Uncertainty Estimation For Open-Set Recognition26 Aug 2024
- 2026ZONOS2 Technical Reportcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verificationcited by 0
- 2026MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification21 Sep 2026
- 2026ZONOS2 Technical Report23 Jun 2026
- 2025The First VoicePrivacy Attacker Challengecited by 4
- 2025The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognitioncited by 4
- 2024Holistic Uncertainty Estimation For Open-Set Recognitioncited by 3
- 2025FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for "U-Tsang, Amdo and Kham Speech Dataset Generationcited by 3
- 2026Scores Know Bobs Voice: Speaker Impersonation Attackcited by 2
- 2025Interpolating Speaker Identities in Embedding Space for Data Expansioncited by 1
- 2025DELULU: Discriminative Embedding Learning Using Latent Units for Speaker-Aware Self-Trained Speech Foundational Modelcited by 1
- 2026What and When to Learn: CURriculum Ranking Loss for Large-Scale Speaker Verificationcited by 1
- 2026POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plancited by 1
- 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognitioncited by 1
- 2026AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identificationcited by 1
- 2024The First VoicePrivacy Attacker Challenge Evaluation Plancited by 0
12 most cited of 21 All 21 (JSON)
- 2026Mixed-Prior Decision Risk for Open-Set Recognition28 Sep 2026
- 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challenge24 Jul 2026
- 2026Simple Language Normalization Wins: Cross-Lingual Speaker Verification for the TidyVoice 2026 Challenge24 Jul 2026
- 2026Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge15 Jul 2026
- 2026AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification28 Jun 2026
- 2026L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification16 Jun 2026
- 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognition4 Jun 2026
- 2026POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan25 Mar 2026
- 2026What and When to Learn: CURriculum Ranking Loss for Large-Scale Speaker Verification25 Mar 2026
- 2026Uncertainty Estimation for the Open-Set Text Classification systems17 Mar 2026
- 2026Scores Know Bobs Voice: Speaker Impersonation Attack3 Mar 2026
- 2026Self-Supervised Learning for Speaker Recognition: A study and review11 Feb 2026
12 newest of 21 All 21 (JSON)