mlsanityData to 14 Oct 2026

From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching

arXiv 2505.09998 ↗First posted 15 May 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In the era of immersive consumer electronics, such as AR/VR headsets and smart devices, people increasingly seek ways to express their identity through virtual fashion. However, existing 3D garment design tools remain inaccessible to everyday users due to steep technical barriers and limited data. In this work, we introduce a 3D sketch-driven 3D garment generation framework that empowers ordinary users - even those without design experience - to create high-quality digital clothing through simple 3D sketches in AR/VR environments. By combining a conditional diffusion model, a sketch encoder trained in a shared latent space, and an adaptive curriculum learning strategy, our system interprets imprecise, free-hand input and produces realistic, personalized garments. To address the scarcity of training data, we also introduce KO3DClothes, a new dataset of paired 3D garments and user-created sketches. Extensive experiments and user studies confirm that our method significantly outperforms existing baselines in both fidelity and usability, demonstrating its promise for democratized fashion design on next-generation consumer platforms.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 82 references that are in the map. First posted on arXiv 15 May 2025.

Builds on

44 of 82 references.

References · 44

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  5. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  6. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  7. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  8. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  9. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  10. 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
  11. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
  12. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
32 more
  1. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  2. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  3. 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
  4. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
  5. 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
  6. 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
  7. 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
  8. 2020Curriculum DeepSDFcited by 62
  9. 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
  10. 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
  11. 2020DeepCloth: Neural Garment Representation for Shape and Style Editingcited by 54
  12. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  13. 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 51
  14. 20173D Shape Reconstruction from Sketches via Multi-view Convolutional Networkscited by 45
  15. 2022Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Imagescited by 39
  16. 2021Generating Datasets of 3D Garments with Sewing Patternscited by 34
  17. 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Modelscited by 23
  18. 2022Computational Pattern Making from 3D Garment Modelscited by 22
  19. 20203D Shape Reconstruction from Free-Hand Sketchescited by 20
  20. 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesiscited by 18
  21. 2020Deep Sketch-Based Modeling: Tips and Trickscited by 15
  22. 2022SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Samplingcited by 14
  23. 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
  24. 20233D VR Sketch Guided 3D Shape Prototyping and Explorationcited by 12
  25. 2022xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Imagecited by 6
  26. 2022Fine-Grained VR Sketching: Dataset and Insightscited by 5
  27. 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fieldscited by 5
  28. 2023Deep3DSketch+: Rapid 3D Modeling from Single Free-hand Sketchescited by 5
  29. 2023Deep3DSketch: 3D modeling from Free-hand Sketches with View- and Structural-Aware Adversarial Trainingcited by 5
  30. 2024Magic3DSketch: Create Colorful 3D Models From Sketch-Based 3D Modeling Guided by Text and Language-Image Pre-Trainingcited by 5
  31. 2023Deep3DSketch++: High-Fidelity 3D Modeling from Single Free-hand Sketchescited by 4
  32. 2023Deep3DSketch+: Obtaining Customized 3D Model by Single Free-Hand Sketch through Deep Learningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidance
  2. 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design
  3. 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
  4. 2025MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization
  5. 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controls
  6. 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics
  7. 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion
  8. 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing