mlsanityData to 7 Oct 2026

XM-ALIGN: Unified Cross-Modal Embedding Alignment for Face-Voice Association

arXiv 2512.06757 ↗First posted 7 Dec 2025cs.SD cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper introduces our solution, XM-ALIGN (Unified Cross-Modal Embedding Alignment Framework), proposed for the FAME challenge at ICASSP 2026. Our framework combines explicit and implicit alignment mechanisms, significantly improving cross-modal verification performance in both "heard" and "unheard" languages. By extracting feature embeddings from both face and voice encoders and jointly optimizing them using a shared classifier, we employ mean squared error (MSE) as the embedding alignment loss to ensure tight alignment between modalities. Additionally, data augmentation strategies are applied during model training to enhance generalization. Experimental results show that our approach demonstrates superior performance on the MAV-Celeb dataset. The code will be released at https://github.com/PunkMale/XM-ALIGN.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 10 of its 13 references that are in the map. First posted on arXiv 7 Dec 2025.

Builds on

10 of 13 references.

References · 10

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  3. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
  4. 2021Fusion and Orthogonal Projection for Improved Face-Voice Associationcited by 29
  5. 2020Cross-modal Speaker Verification and Recognition: A Multilingual Perspectivecited by 26
  6. 2021A Multi-View Approach To Audio-Visual Speaker Verificationcited by 23
  7. 2019Deep Latent Space Learning for Cross-modal Mapping of Audio and Visual Signalscited by 20
  8. 2023Single-branch Network for Multimodal Trainingcited by 13
  9. 2025PAEFF: Precise Alignment and Enhanced Gated Feature Fusion for Face-Voice Associationcited by 9
  10. 2025Face-voice Association in Multilingual Environments (FAME) 2026 Challenge Evaluation Plancited by 6

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.