mlsanityData to 14 Oct 2026

TalkFashion: Intelligent Virtual Try-On Assistant Based on Multimodal Large Language Model

arXiv 2507.05790 ↗First posted 8 Jul 2025cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Virtual try-on has made significant progress in recent years. This paper addresses how to achieve multifunctional virtual try-on guided solely by text instructions, including full outfit change and local editing. Previous methods primarily relied on end-to-end networks to perform single try-on tasks, lacking versatility and flexibility. We propose TalkFashion, an intelligent try-on assistant that leverages the powerful comprehension capabilities of large language models to analyze user instructions and determine which task to execute, thereby activating different processing pipelines accordingly. Additionally, we introduce an instruction-based local repainting model that eliminates the need for users to manually provide masks. With the help of multi-modal models, this approach achieves fully automated local editings, enhancing the flexibility of editing tasks. The experimental results demonstrate better semantic consistency and visual quality compared to the current methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 43 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

39 of 43 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2023Segment Anythingcited by 8,234
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
27 more
  1. 2024Qwen2 Technical Reportcited by 2,120
  2. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  4. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  5. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  6. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  7. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  8. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  9. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  10. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 248
  11. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
  12. 2019Self-Correction for Human Parsingcited by 180
  13. 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
  14. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
  15. 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 149
  16. 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 130
  17. 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
  18. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
  19. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wildcited by 109
  20. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 102
  21. 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editingcited by 88
  22. 2024ViViD: Video Virtual Try-on using Diffusion Modelscited by 42
  23. 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
  24. 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
  25. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  26. 2024M&M VTO: Multi-Garment Virtual Try-On and Editingcited by 29
  27. 2024MMTryon: Multi-Modal Multi-Reference Control for High-Quality Fashion Generationcited by 23

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing
  2. 2025UniFit: Towards Universal Virtual Try-on with MLLM-Guided Semantic Alignment
  3. 2024PromptDresser: Improving the Quality and Controllability of Virtual Try-On via Generative Textual Prompt and Prompt-aware Mask
  4. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Models
  5. 2025InstructVTON: Optimal Auto-Masking and Natural-Language-Guided Interactive Style Control for Inpainting-Based Virtual Try-On
  6. 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment
  7. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
  8. 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing