From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching
Not on the map. Why?
Abstract (arXiv)
In the era of immersive consumer electronics, such as AR/VR headsets and smart devices, people increasingly seek ways to express their identity through virtual fashion. However, existing 3D garment design tools remain inaccessible to everyday users due to steep technical barriers and limited data. In this work, we introduce a 3D sketch-driven 3D garment generation framework that empowers ordinary users - even those without design experience - to create high-quality digital clothing through simple 3D sketches in AR/VR environments. By combining a conditional diffusion model, a sketch encoder trained in a shared latent space, and an adaptive curriculum learning strategy, our system interprets imprecise, free-hand input and produces realistic, personalized garments. To address the scarcity of training data, we also introduce KO3DClothes, a new dataset of paired 3D garments and user-created sketches. Extensive experiments and user studies confirm that our method significantly outperforms existing baselines in both fidelity and usability, demonstrating its promise for democratized fashion design on next-generation consumer platforms.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 82 references that are in the map. First posted on arXiv 15 May 2025.
Builds on
44 of 82 references.
References · 44
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
32 more
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
- 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
- 2020Curriculum DeepSDFcited by 62
- 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
- 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
- 2020DeepCloth: Neural Garment Representation for Shape and Style Editingcited by 54
- 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
- 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 51
- 20173D Shape Reconstruction from Sketches via Multi-view Convolutional Networkscited by 45
- 2022Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Imagescited by 39
- 2021Generating Datasets of 3D Garments with Sewing Patternscited by 34
- 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Modelscited by 23
- 2022Computational Pattern Making from 3D Garment Modelscited by 22
- 20203D Shape Reconstruction from Free-Hand Sketchescited by 20
- 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesiscited by 18
- 2020Deep Sketch-Based Modeling: Tips and Trickscited by 15
- 2022SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Samplingcited by 14
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
- 20233D VR Sketch Guided 3D Shape Prototyping and Explorationcited by 12
- 2022xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Imagecited by 6
- 2022Fine-Grained VR Sketching: Dataset and Insightscited by 5
- 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fieldscited by 5
- 2023Deep3DSketch+: Rapid 3D Modeling from Single Free-hand Sketchescited by 5
- 2023Deep3DSketch: 3D modeling from Free-hand Sketches with View- and Structural-Aware Adversarial Trainingcited by 5
- 2024Magic3DSketch: Create Colorful 3D Models From Sketch-Based 3D Modeling Guided by Text and Language-Image Pre-Trainingcited by 5
- 2023Deep3DSketch++: High-Fidelity 3D Modeling from Single Free-hand Sketchescited by 4
- 2023Deep3DSketch+: Obtaining Customized 3D Model by Single Free-Hand Sketch through Deep Learningcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidance
- 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
- 2025MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization
- 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controls
- 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics
- 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion
- 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing