mlsanityData to 14 Oct 2026

LUIVITON: Learned Universal Interoperable VIrtual Try-ON

arXiv 2509.05030 ↗First posted 5 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

To enable large-scale reuse of real-world 3D assets, where garments and characters rarely share skeletons, templates, or dense correspondences, we present a fully automated virtual try-on system that dresses complex, multi-layer garments onto diverse, arbitrarily posed humanoids. Our key idea is to use SMPL as an intermediate proxy and decompose clothing-to-body transfer into two correspondence tasks with distinct challenges: (1) clothing-to-SMPL (partial-to-complete alignment) and (2) body-to-SMPL (large pose/shape variation and stylization). We address clothing-to-SMPL using a geometry-driven correspondence model, and introduce a diffusion-based body-to-SMPL correspondence approach that leverages multi-view consistent appearance features together with a pretrained 2D foundation model. Using these correspondences, we register SMPL/SMPL+D (Displacement) to the garment and target body and then perform simulator-driven fitting by transferring the garment along a smooth SMPL-to-SMPL+D transition, producing physically plausible draping on the target. Our system handles complex garment topology (including non-manifold meshes) and generalizes to a wide range of humanoid characters (e.g., humans, robots, cartoons, and creatures) while remaining computationally practical. Upon draping, our system also supports fast customization of clothing size. We show that our system can produce high-quality 3D clothing fittings without any human labor, even when 2D clothing sewing patterns are not available. Our project page is: https://cao-cong0.github.io/LUIVITON-Learned-Universal-Interoperable-VIrtual-Try-ON/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 60 references that are in the map. First posted on arXiv 5 Sep 2025.

Builds on

32 of 60 references.

References · 32

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  4. 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 164
  5. 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 149
  6. 2017Deep Functional Maps: Structured Prediction for Dense Shape Correspondencecited by 134
  7. 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
  8. 2020Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondencecited by 125
  9. 2019CLOTH3D: Clothed 3D Humanscited by 116
  10. 2019Learning-Based Animation of Clothing for Virtual Try-Oncited by 89
  11. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  12. 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
20 more
  1. 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
  2. 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 78
  3. 20203D Human Mesh Regression with Dense Correspondencecited by 66
  4. 2020PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformationcited by 63
  5. 2015Partial Functional Correspondencecited by 61
  6. 2023Unsupervised Learning of Robust Spectral Shape Matchingcited by 57
  7. 2023Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Featurescited by 55
  8. 2020DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animationcited by 43
  9. 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 41
  10. 2022Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networkscited by 39
  11. 2022Neural Cloth Simulationcited by 36
  12. 2023Zero-Shot 3D Shape Correspondencecited by 33
  13. 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patternscited by 32
  14. 2024GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patternscited by 28
  15. 2015Dense Human Body Correspondences Using Convolutional Networkscited by 26
  16. 2024ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulationscited by 23
  17. 2023NICP: Neural ICP for 3D Human Registration at Scalecited by 21
  18. 2023Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matchingcited by 18
  19. 2024Memory-Scalable and Simplified Functional Map Learningcited by 14
  20. 2013Spectral Generalized Multi-Dimensional Scalingcited by 11

Built on by

Not cited yet.