OmniFashion: Towards Generalist Fashion Intelligence via Multi-Task Vision-Language Learning
Not on the map. Why?
Abstract (arXiv)
Fashion intelligence spans multiple tasks, i.e., retrieval, recommendation, recognition, and dialogue, yet remains hindered by fragmented supervision and incomplete fashion annotations. These limitations jointly restrict the formation of consistent visual-semantic structures, preventing recent vision-language models (VLMs) from serving as a generalist fashion brain that unifies understanding and reasoning across tasks. Therefore, we construct FashionX, a million-scale dataset that exhaustively annotates visible fashion items within an outfit and organizes attributes from global to part-level. Built upon this foundation, we propose OmniFashion, a unified vision-language framework that bridges diverse fashion tasks under a unified fashion dialogue paradigm, enabling both multi-task reasoning and interactive dialogue. Experiments on multi-subtasks and retrieval benchmarks show that OmniFashion achieves strong task-level accuracy and cross-task generalization, highlighting its offering of a scalable path toward universal, dialogue-oriented fashion intelligence.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 79 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
42 of 79 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 134
- 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 111
- 2023ChatPose: Chatting about 3D Human Posecited by 72
30 more
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2018Fashion-Gen: The Generative Fashion Dataset and Challengecited by 65
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
- 2020Fashionpedia: Ontology, Segmentation, and an Attribute Localization Datasetcited by 57
- 2020FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrievalcited by 55
- 2024Rethinking Bradley-Terry Models in Preference-Based Reward Modeling: Foundations, Theory, and Alternativescited by 48
- 2021On the Unreasonable Effectiveness of Centroids in Image Retrievalcited by 45
- 2025Personalized Generation In Large Model Era: A Surveycited by 45
- 2019Fashion Outfit Complementary Item Retrievalcited by 42
- 2022Contrastive language and vision learning of general fashion conceptscited by 42
- 2023FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Taskscited by 38
- 2021Learning Intra-Batch Connections for Deep Metric Learningcited by 34
- 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learningcited by 32
- 2022A Review of Modern Fashion Recommender Systemscited by 25
- 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Modelscited by 23
- 2016Fashion Landmark Detection in the Wildcited by 21
- 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesiscited by 20
- 2023Image-Based Virtual Try-On: A Surveycited by 19
- 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generationcited by 17
- 2022ARMANI: Part-level Garment-Text Alignment for Unified Cross-Modal Fashion Designcited by 16
- 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Modelcited by 11
- 2022Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Searchcited by 10
- 2019A weakly supervised adaptive triplet loss for deep metric learningcited by 9
- 2023OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Datacited by 9
- 2024Towards Improved Proxy-based Deep Metric Learning via Data-Augmented Domain Adaptationcited by 9
- 2020A Strong Baseline for Fashion Retrieval with Person Re-Identification Modelscited by 7
- 2022FashionVQA: A Domain-Specific Visual Question Answering Systemcited by 6
- 2025FashionM3: Multimodal, Multitask, and Multiround Fashion Assistant based on Unified Vision-Language Modelcited by 2
- 2023Fashion Image Retrieval with Multi-Granular Alignmentcited by 1
- 2023Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrievalcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FashionStylist: An Expert Knowledge-enhanced Multimodal Dataset for Fashion Understanding
- 2026ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval
- 2023Fashion Matrix: Editing Photos by Just Talking
- 2026FashionLens: Toward Versatile Fashion Image Retrieval via Task-Adaptive Learning
- 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training
- 2026Exploring Multi-Modal Large Language Models and Two-Stage Fine-Tuning for Fashion Image Retrieval
- 2026Diverse-Intent Multi-Turn Fashion Image Retrieval
- 2026RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes