Mixed-Modality Dual Face-Hair Retrieval
Not on the map. Why?
Abstract (arXiv)
We introduce Dual Face-Hair Retrieval (DFHR), a new mixed-modality dual-reference task in image retrieval where a query consists of a face image specifying identity and a hairstyle reference expressed as either an image or text. Unlike prior retrieval settings, DFHR requires cross-component reasoning between two semantically independent attributes -- identity and hairstyle -- originating from heterogeneous modalities. This formulation demands localized feature disentanglement, cross-modal semantic alignment, and mixed-modality composition within a unified embedding space. We construct DFHR-Bench, the first benchmark for mixed-modality face-hair retrieval, comprising over 180K annotated triplets across dual-image and image-text settings, built via a multi-stage annotation protocol ensuring semantic and identity integrity. We further propose MFHC (Multimodal Face-Hair Combiner), a unified framework that fuses disentangled identity and hairstyle embeddings through token injection and multi-view supervision. DFHR and DFHR-Bench together establish a new paradigm for identity-aware, attribute-controllable visual retrieval across modalities.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 72 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
23 of 72 references.
References · 23
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023Qwen Technical Reportcited by 3,344
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
- 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 223
- 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 83
- 2019Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedbackcited by 43
11 more
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 43
- 2020MAAD-Face: A Massively Annotated Attribute Dataset for Face Imagescited by 32
- 2023Zero-shot Composed Text-Image Retrievalcited by 32
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 17
- 2025FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMscited by 12
- 2022Learning-From-Disagreement: A Model Comparison and Visual Analytics Frameworkcited by 10
- 2023How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweetscited by 10
- 2019Assessing Data Quality of Annotations with Krippendorff Alpha For Applications in Computer Visioncited by 7
- 2025Bias in, Bias out: Annotation Bias in Multilingual Large Language Modelscited by 5
- 2024Towards Identity-Aware Cross-Modal Retrieval: a Dataset and a Baselinecited by 2
- 2024Bias Similarity Measurement: A Black-Box Audit of Fairness Across LLMscited by 1
Built on by
Not cited yet.