mlsanityData to 14 Oct 2026

TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models

arXiv 2411.18350 ↗First posted 27 Nov 2024cs.CV cs.AIcited by 19

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

This paper introduces Virtual Try-Off (VTOFF), a novel task generating standardized garment images from single photos of clothed individuals. Unlike Virtual Try-On (VTON), which digitally dresses models, VTOFF extracts canonical garment images, demanding precise reconstruction of shape, texture, and complex patterns, enabling robust evaluation of generative model fidelity. We propose TryOffDiff, adapting Stable Diffusion with SigLIP-based visual conditioning to deliver high-fidelity reconstructions. Experiments on VITON-HD and Dress Code datasets show that TryOffDiff outperforms adapted pose transfer and VTON baselines. We observe that traditional metrics such as SSIM inadequately reflect reconstruction quality, prompting our use of DISTS for reliable assessment. Our findings highlight VTOFF's potential to improve e-commerce product imagery, advance generative model evaluation, and guide future research on high-fidelity reconstruction. Demo, code, and models are available at: https://rizavelioglu.github.io/tryoffdiff

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 45 of its 65 references that are in the map. First posted on arXiv 27 Nov 2024.

Builds on

45 of 65 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul
  2. 2024FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on22 Apr
  3. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on4 Mar
  4. 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models10 Oct
  5. 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesis15 Aug
  6. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr

Other references · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2023Segment Anythingcited by 8,234
  6. 2016Layer Normalizationcited by 5,669
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2014Going Deeper with Convolutionscited by 4,241
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  11. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
27 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  2. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  4. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  5. 2023Zero-shot Image-to-Image Translationcited by 505
  6. 2015A note on the evaluation of generative modelscited by 292
  7. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  8. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  9. 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
  10. 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
  11. 2016View Synthesis by Appearance Flowcited by 172
  12. 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 162
  13. 2021Parser-Free Virtual Try-on via Distilling Appearance Flowscited by 143
  14. 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 134
  15. 2015Deep Convolutional Inverse Graphics Networkcited by 121
  16. 2015Multi-view 3D Models from Single Images with a Convolutional Networkcited by 58
  17. 2021Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editingcited by 54
  18. 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidancecited by 44
  19. 2021Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GANcited by 40
  20. 2017The Conditional Analogy GAN: Swapping Fashion Articles on People Imagescited by 33
  21. 2017Multi-View Image Generation from a Single-Viewcited by 27
  22. 2023NViST: In the Wild New View Synthesis from a Single Image with Transformerscited by 19
  23. 2022ARMANI: Part-level Garment-Text Alignment for Unified Cross-Modal Fashion Designcited by 16
  24. 2023DiffCloth: Diffusion Based Garment Synthesis and Manipulation via Structural Cross-modal Semantic Alignmentcited by 15
  25. 2022Multi-scale Attention Guided Pose Transfercited by 10
  26. 2023ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNetcited by 7
  27. 2024FashionFail: Addressing Failure Cases in Fashion Object Detection and Segmentationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 8.

19 papers.

Sort:

By area:

  1. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  2. 2024RAGDiffusion: Faithful Cloth Generation via External Knowledge Assimilationcited by 9
  3. 2025Voost: A Unified and Scalable Diffusion Transformer for Bidirectional Virtual Try-On and Try-Offcited by 8
  4. 2025JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-oncited by 7
  5. 2025MGT: Extending Virtual Try-Off to Multi-Garment Scenarioscited by 6
  6. 2024IGR: Improving Diffusion Model for Garment Restoration from Person Imagecited by 5
  7. 2025Inverse Virtual Try-On: Generating Multi-Category Product-Style Images from Clothed Individualscited by 4
  8. 2025MFP-VTON: Enhancing Mask-Free Person-to-Person Virtual Try-On via Diffusion Transformercited by 2
  9. 2025NI-Tex: Non-isometric Image-based Garment Texture Generationcited by 2
  10. 2026OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generationcited by 2
  11. 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusioncited by 1
  12. 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Frameworkcited by 1
7 more
  1. 2026UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-oncited by 1
  2. 2025Two-Way Garment Transfer: Unified Diffusion Framework for Dressing and Undressing Synthesiscited by 0
  3. 2026AlignVTOFF: Texture-Spatial Feature Alignment for High-Fidelity Virtual Try-Offcited by 0
  4. 2026BridgeDiff: Bridging Human Observations and Flat-Garment Synthesis for Virtual Try-Offcited by 0
  5. 2026Dress-ED: Instruction-Guided Editing for Virtual Try-On and Try-Offcited by 0
  6. 2026What Matters in Virtual Try-Off? Dual-UNet Diffusion Model For Garment Reconstructioncited by 0
  7. 2026RAGDiffusion++: From Macro-Retrieval to Micro-Fidelity Alignment for Garment Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025DiffFit: Disentangled Garment Warping and Texture Refinement for Virtual Try-On
  2. 2024Improving Virtual Try-On with Garment-focused Diffusion Models
  3. 2024TryOffAnyone: Tiled Cloth Generation from a Dressed Person
  4. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild
  5. 2025EfficientVITON: An Efficient Virtual Try-On Model using Optimized Diffusion Process
  6. 2024MV-VTON: Multi-View Virtual Try-On with Diffusion Models
  7. 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates
  8. 2024M&M VTO: Multi-Garment Virtual Try-On and Editing