mlsanityData to 14 Oct 2026

Dress-ED: Instruction-Guided Editing for Virtual Try-On and Try-Off

arXiv 2603.22607 ↗First posted 23 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in Virtual Try-On (VTON) and Virtual Try-Off (VTOFF) have greatly improved photo-realistic fashion synthesis and garment reconstruction. However, existing datasets remain static, lacking instruction-driven editing for controllable and interactive fashion generation. In this work, we introduce the Dress Editing Dataset (Dress-ED), the first large-scale benchmark that unifies VTON, VTOFF, and text-guided garment editing within a single framework. Each sample in Dress-ED includes an in-shop garment image, the corresponding person image wearing the garment, their edited counterparts, and a natural-language instruction of the desired modification. Built through a fully automated multimodal pipeline that integrates MLLM-based garment understanding, diffusion-based editing, and LLM-guided verification, Dress-ED comprises over 146k verified quadruplets spanning three garment categories and seven edit types, including both appearance (e.g., color, pattern, material) and structural (e.g., sleeve length, neckline) modifications. Based on this benchmark, we further propose a unified multimodal diffusion framework that jointly reasons over linguistic instructions and visual garment cues, serving as a strong baseline for instruction-driven VTON and VTOFF. Dataset and code available at this link: https://github.com/aimagelab/Dress-ED

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 61 of its 72 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

61 of 72 references.

References · 61

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  9. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  10. 2018Demystifying MMD GANscited by 1,293
  11. 2025Qwen-Image Technical Reportcited by 1,044
  12. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
38 more
  1. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  2. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  3. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  4. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  5. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  6. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  7. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  8. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  9. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  10. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  11. 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
  12. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
  13. 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
  14. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
  15. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  16. 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 162
  17. 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 152
  18. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  19. 2023TryOnDiffusion: A Tale of Two UNetscited by 141
  20. 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 134
  21. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 128
  22. 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
  23. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  24. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 102
  25. 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 65
  26. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  27. 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
  28. 2021Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editingcited by 54
  29. 2024FitDiT: Advancing the Authentic Garment Details for High-fidelity Virtual Try-oncited by 40
  30. 2024Steering Rectified Flow Models in the Vector Field for Controlled Image Generationcited by 39
  31. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
  32. 2024EditWorld: Simulating World Dynamics for Instruction-Following Image Editingcited by 38
  33. 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
  34. 2022C-VTON: Context-Driven Image-Based Virtual Try-On Networkcited by 29
  35. 2024M&M VTO: Multi-Garment Virtual Try-On and Editingcited by 29
  36. 2024Learning Flow Fields in Attention for Controllable Person Image Generationcited by 27
  37. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
  38. 2024AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenariocited by 23

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024PromptDresser: Improving the Quality and Controllability of Virtual Try-On via Generative Textual Prompt and Prompt-aware Mask
  2. 2026Beyond Global Realism: Virtual Try-On Evaluation and Optimization with Dimension-wise Garment Fidelity Assessment
  3. 2026Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On
  4. 2024DPDEdit: Detail-Preserved Diffusion Models for Multimodal Fashion Image Editing
  5. 2025MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization
  6. 2025Fashion-RAG: Multimodal Fashion Image Editing via Retrieval-Augmented Generation
  7. 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing
  8. 2026What Matters in Virtual Try-Off? Dual-UNet Diffusion Model For Garment Reconstruction