mlsanityData to 14 Oct 2026

OmniFashion: Towards Generalist Fashion Intelligence via Multi-Task Vision-Language Learning

arXiv 2603.02658 ↗First posted 3 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Fashion intelligence spans multiple tasks, i.e., retrieval, recommendation, recognition, and dialogue, yet remains hindered by fragmented supervision and incomplete fashion annotations. These limitations jointly restrict the formation of consistent visual-semantic structures, preventing recent vision-language models (VLMs) from serving as a generalist fashion brain that unifies understanding and reasoning across tasks. Therefore, we construct FashionX, a million-scale dataset that exhaustively annotates visible fashion items within an outfit and organizes attributes from global to part-level. Built upon this foundation, we propose OmniFashion, a unified vision-language framework that bridges diverse fashion tasks under a unified fashion dialogue paradigm, enabling both multi-task reasoning and interactive dialogue. Experiments on multi-subtasks and retrieval benchmarks show that OmniFashion achieves strong task-level accuracy and cross-task generalization, highlighting its offering of a scalable path toward universal, dialogue-oriented fashion intelligence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 79 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

42 of 79 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  7. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  8. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  9. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  10. 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 134
  11. 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 111
  12. 2023ChatPose: Chatting about 3D Human Posecited by 72
30 more
  1. 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
  2. 2018Fashion-Gen: The Generative Fashion Dataset and Challengecited by 65
  3. 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
  4. 2020Fashionpedia: Ontology, Segmentation, and an Attribute Localization Datasetcited by 57
  5. 2020FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrievalcited by 55
  6. 2024Rethinking Bradley-Terry Models in Preference-Based Reward Modeling: Foundations, Theory, and Alternativescited by 48
  7. 2021On the Unreasonable Effectiveness of Centroids in Image Retrievalcited by 45
  8. 2025Personalized Generation In Large Model Era: A Surveycited by 45
  9. 2019Fashion Outfit Complementary Item Retrievalcited by 42
  10. 2022Contrastive language and vision learning of general fashion conceptscited by 42
  11. 2023FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Taskscited by 38
  12. 2021Learning Intra-Batch Connections for Deep Metric Learningcited by 34
  13. 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learningcited by 32
  14. 2022A Review of Modern Fashion Recommender Systemscited by 25
  15. 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Modelscited by 23
  16. 2016Fashion Landmark Detection in the Wildcited by 21
  17. 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesiscited by 20
  18. 2023Image-Based Virtual Try-On: A Surveycited by 19
  19. 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generationcited by 17
  20. 2022ARMANI: Part-level Garment-Text Alignment for Unified Cross-Modal Fashion Designcited by 16
  21. 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Modelcited by 11
  22. 2022Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Searchcited by 10
  23. 2019A weakly supervised adaptive triplet loss for deep metric learningcited by 9
  24. 2023OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Datacited by 9
  25. 2024Towards Improved Proxy-based Deep Metric Learning via Data-Augmented Domain Adaptationcited by 9
  26. 2020A Strong Baseline for Fashion Retrieval with Person Re-Identification Modelscited by 7
  27. 2022FashionVQA: A Domain-Specific Visual Question Answering Systemcited by 6
  28. 2025FashionM3: Multimodal, Multitask, and Multiround Fashion Assistant based on Unified Vision-Language Modelcited by 2
  29. 2023Fashion Image Retrieval with Multi-Granular Alignmentcited by 1
  30. 2023Lost Your Style? Navigating with Semantic-Level Approach for Text-to-Outfit Retrievalcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FashionStylist: An Expert Knowledge-enhanced Multimodal Dataset for Fashion Understanding
  2. 2026ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval
  3. 2023Fashion Matrix: Editing Photos by Just Talking
  4. 2026FashionLens: Toward Versatile Fashion Image Retrieval via Task-Adaptive Learning
  5. 2023FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training
  6. 2026Exploring Multi-Modal Large Language Models and Two-Stage Fine-Tuning for Fashion Image Retrieval
  7. 2026Diverse-Intent Multi-Turn Fashion Image Retrieval
  8. 2026RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes