POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan
Not on the map. Why?
Abstract (arXiv)
Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing. However, in real-world applications, such assumptions often do not hold. Visual information may be missing due to occlusions, camera failures, or privacy constraints, while multilingual speakers introduce additional complexity due to linguistic variability across languages. These challenges significantly affect the robustness and generalization of multimodal speaker identification systems. The POLY-SIM Grand Challenge 2026 aims to advance research in multimodal speaker identification under missing-modality and cross-lingual conditions. Specifically, the Grand Challenge encourages the development of robust methods that can effectively leverage incomplete multimodal inputs while maintaining strong performance across different languages. This report presents the design and organization of the POLY-SIM Grand Challenge 2026, including the dataset, task formulation, evaluation protocol, and baseline model. By providing a standardized benchmark and evaluation framework, the challenge aims to foster progress toward more robust and practical multimodal speaker identification systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
28 of 44 references.
References · 28
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2017Gated Multimodal Units for Information Fusioncited by 244
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
- 2022Are Multimodal Transformers Robust to Missing Modality?cited by 183
- 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
- 2021Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detectioncited by 110
- 2021Fusion and Orthogonal Projection for Improved Face-Voice Associationcited by 29
- 2020Cross-modal Speaker Verification and Recognition: A Multilingual Perspectivecited by 26
16 more
- 2024Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognitioncited by 26
- 2020Audio-visual Speaker Recognition with a Cross-modal Discriminative Networkcited by 24
- 2024VoxBlink2: A 100K+ Speaker Recognition Corpus and the Open-Set Speaker-Identification Benchmarkcited by 24
- 2024A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarioscited by 12
- 2023Target Active Speaker Detection with Audio-visual Cuescited by 11
- 2024The VoxCeleb Speaker Recognition Challenge: A Retrospectivecited by 9
- 2019Short-duration Speaker Verification (SdSV) Challenge 2021: the Challenge Evaluation Plancited by 8
- 2025Face-voice Association in Multilingual Environments (FAME) 2026 Challenge Evaluation Plancited by 6
- 2025SVeritas: Benchmark for Robust Speaker Verification under Diverse Conditionscited by 6
- 2021Tackling the Score Shift in Cross-Lingual Speaker Verification by Exploiting Language Informationcited by 5
- 2025Linking Faces and Voices Across Languages: Insights from the FAME 2026 Challengecited by 5
- 2020Cross-Lingual Speaker Verification with Domain-Balanced Hard Prototype Mining and Language-Dependent Score Normalizationcited by 4
- 2024Modality Invariant Multimodal Learning to Handle Missing Modalities: A Single-Branch Approachcited by 4
- 2025Single-Branch Network Architectures to Close the Modality Gap in Multimodal Recommendationcited by 3
- 2025Shared Multi-modal Embedding Space for Face-Voice Associationcited by 2
- 2026Robust Harmful Meme Detection under Missing Modalities via Shared Representation Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.