mlsanityData to 7 Oct 2026

Disjoint Mapping Network for Cross-modal Matching of Voices and Faces

arXiv 1807.04836 ↗First posted 12 Jul 2018cs.CVcited by 22

Not on the map. Why?

Abstract (arXiv)

We propose a novel framework, called Disjoint Mapping Network (DIMNet), for cross-modal biometric matching, in particular of voices and faces. Different from the existing methods, DIMNet does not explicitly learn the joint relationship between the modalities. Instead, DIMNet learns a shared representation for different modalities by mapping them individually to their common covariates. These shared representations can then be used to find the correspondences between the modalities. We show empirically that DIMNet is able to achieve better performance than other current methods, with the additional benefits of being conceptually simpler and less data-intensive.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jul 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 5; 2023: 3; 2024: 2; 2025: 2; 2026: 2.

22 papers.

Sort:

  1. 2021VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistencycited by 114
  2. 2021Fusion and Orthogonal Projection for Improved Face-Voice Associationcited by 29
  3. 2021AVA-AVD: Audio-Visual Speaker Diarization in the Wildcited by 24
  4. 2021Seeking the Shape of Sound: An Adaptive Framework for Learning Voice-Face Associationcited by 21
  5. 2023Single-branch Network for Multimodal Trainingcited by 13
  6. 2021Audio-to-Image Cross-Modal Generationcited by 11
  7. 2022A Comprehensive Survey on Video Saliency Detection with Auditory Information: the Audio-visual Consistency Perceptual is the Key!cited by 9
  8. 2023Speaker Recognition in Realistic Scenario Using Multimodal Datacited by 9
  9. 2025PAEFF: Precise Alignment and Enhanced Gated Feature Fusion for Face-Voice Associationcited by 9
  10. 2021Integrating Auxiliary Information in Self-supervised Learningcited by 6
  11. 2022Learning Weakly-Supervised Contrastive Representationscited by 6
  12. 2022Unsupervised Voice-Face Representation Learning by Cross-Modal Prototype Contrastcited by 6
10 more
  1. 2023Audio-Visual Speaker Verification via Joint Cross-Attentioncited by 4
  2. 2021Controlled AutoEncoders to Generate Faces from Voicescited by 3
  3. 2022Learning Branched Fusion and Orthogonal Projection for Face-Voice Associationcited by 3
  4. 2022A Multimodal Sensor Fusion Framework Robust to Missing Modalities for Person Recognitioncited by 3
  5. 2021Discriminative Semantic Transitive Consistency for Cross-Modal Learningcited by 1
  6. 2024Exploring Robust Face-Voice Matching in Multilingual Environmentscited by 1
  7. 2026Face-Voice Association with Inductive Bias for Maximum Class Separationcited by 1
  8. 2024Fuse after Align: Improving Face-Voice Association Learning via Multimodal Encodercited by 0
  9. 2025SSAVSV: Towards Unified Model for Self-Supervised Audio-Visual Speaker Verificationcited by 0
  10. 2026Face and Voice Cross-modal Association with Learning Convex Feature Embeddingcited by 0