mlsanityData to 7 Oct 2026

Audio-visual Speaker Recognition with a Cross-modal Discriminative Network

arXiv 2008.03894 ↗First posted 10 Aug 2020eess.AScited by 24

Not on the map. Why?

Abstract (arXiv)

Audio-visual speaker recognition is one of the tasks in the recent 2019 NIST speaker recognition evaluation (SRE). Studies in neuroscience and computer science all point to the fact that vision and auditory neural signals interact in the cognitive process. This motivated us to study a cross-modal network, namely voice-face discriminative network (VFNet) that establishes the general relation between human voice and face. Experiments show that VFNet provides additional speaker discriminative information. With VFNet, we achieve 16.54% equal error rate relative reduction over the score level fusion audio-visual baseline on evaluation set of 2019 NIST SRE.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 5; 2023: 6; 2024: 4; 2025: 3; 2026: 3.

24 papers.

Sort:

  1. 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 24
  2. 2021A Multi-View Approach To Audio-Visual Speaker Verificationcited by 23
  3. 2024Multimodal Action Quality Assessmentcited by 20
  4. 2023Single-branch Network for Multimodal Trainingcited by 13
  5. 2022MFA: TDNN with Multi-scale Frequency-channel Attention for Text-independent Speaker Verification with Short Utterancescited by 12
  6. 2022Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?cited by 8
  7. 2025Face-voice Association in Multilingual Environments (FAME) 2026 Challenge Evaluation Plancited by 6
  8. 2025Linking Faces and Voices Across Languages: Insights from the FAME 2026 Challengecited by 5
  9. 2023CN-Celeb-AV: A Multi-Genre Audio-Visual Dataset for Person Recognitioncited by 4
  10. 2023Audio-Visual Speaker Verification via Joint Cross-Attentioncited by 4
  11. 2024Face-voice Association in Multilingual Environments (FAME) Challenge 2024 Evaluation Plancited by 4
  12. 2022Learning Branched Fusion and Orthogonal Projection for Face-Voice Associationcited by 3
12 more
  1. 2022A Multimodal Sensor Fusion Framework Robust to Missing Modalities for Person Recognitioncited by 3
  2. 2023Cross-modal Audio-visual Co-learning for Text-independent Speaker Verificationcited by 3
  3. 2023Rethinking Voice-Face Correlation: A Geometry Viewcited by 3
  4. 2024VoxVietnam: a Large-Scale Multi-Genre Dataset for Vietnamese Speaker Recognitioncited by 3
  5. 2024Comparative Analysis of Modality Fusion Approaches for Audio-Visual Person Identification and Verificationcited by 2
  6. 2022Graph-based Multi-View Fusion and Local Adaptation: Mitigating Within-Household Confusability for Speaker Identificationcited by 1
  7. 2023Getting More for Less: Using Weak Labels and AV-Mixup for Robust Audio-Visual Speaker Verificationcited by 1
  8. 2026POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plancited by 1
  9. 2021Exploring Deep Learning for Joint Audio-Visual Lip Biometricscited by 0
  10. 2025SSAVSV: Towards Unified Model for Self-Supervised Audio-Visual Speaker Verificationcited by 0
  11. 2026Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challengecited by 0
  12. 2026Face and Voice Cross-modal Association with Learning Convex Feature Embeddingcited by 0