Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fields
Not on the map. Why?
Abstract (arXiv)
3D model reconstruction from a single image has achieved great progress with the recent deep generative models. However, the conventional reconstruction approaches with template mesh deformation and implicit fields have difficulty in reconstructing non-watertight 3D mesh models, such as garments. In contrast to image-based modeling, the sketch-based approach can help users generate 3D models to meet the design intentions from hand-drawn sketches. In this study, we propose Sketch2Cloth, a sketch-based 3D garment generation system using the unsigned distance fields from the user's sketch input. Sketch2Cloth first estimates the unsigned distance function of the target 3D model from the sketch input, and extracts the mesh from the estimated field with Marching Cubes. We also provide the model editing function to modify the generated mesh. We verified the proposed Sketch2Cloth with quantitative evaluations on garment generation and editing with a state-of-the-art approach.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 1 Mar 2023.
Builds on
29 of 36 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
17 more
- 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
- 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 101
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 75
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 62
- 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
- 2018Learning a Shared Shape Space for Multimodal Garment Designcited by 52
- 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
- 20173D Shape Reconstruction from Sketches via Multi-view Convolutional Networkscited by 44
- 2015Sketch-based 3D Shape Retrieval using Convolutional Neural Networkscited by 41
- 20173D Sketching using Multi-View Deep Volumetric Predictioncited by 36
- 2021Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstructioncited by 36
- 2021dualFace:Two-Stage Drawing Guidance for Freehand Portrait Sketchingcited by 8
- 2022DualSmoke: Sketch-Based Smoke Illustration Design with Two-Stage Generative Modelcited by 6
- 2023DiffFaceSketch: High-Fidelity Face Image Synthesis with Sketch-Guided Latent Diffusion Modelcited by 5
- 2021Sketch-based Normal Map Generation with Geometric Samplingcited by 3
- 2022DualMotion: Global-to-Local Casual Motion Design for Character Animationscited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 1.
5 papers.
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Detailscited by 19
- 2024Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generationcited by 6
- 2024TexControl: Sketch-Based Two-Stage Fashion Image Generation Using Diffusion Modelcited by 1
- 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketchingcited by 1
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patternscited by 0
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching15 May 2025
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details20 May 2024
- 2024TexControl: Sketch-Based Two-Stage Fashion Image Generation Using Diffusion Model7 May 2024
- 2024Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation25 Jan 2024