Towards Garment Sewing Pattern Reconstruction from a Single Image
Not on the map. Why?
Abstract (arXiv)
Garment sewing pattern represents the intrinsic rest shape of a garment, and is the core for many applications like fashion design, virtual try-on, and digital avatars. In this work, we explore the challenging problem of recovering garment sewing patterns from daily photos for augmenting these applications. To solve the problem, we first synthesize a versatile dataset, named SewFactory, which consists of around 1M images and ground-truth sewing patterns for model training and quantitative evaluation. SewFactory covers a wide range of human poses, body shapes, and sewing patterns, and possesses realistic appearances thanks to the proposed human texture synthesis network. Then, we propose a two-level Transformer network called Sewformer, which significantly improves the sewing pattern prediction performance. Extensive experiments demonstrate that the proposed framework is effective in recovering sewing patterns and well generalizes to casually-taken human photos. Code, dataset, and pre-trained models are available at: https://sewformer.github.io.
Key facts. Cited by 33 papers in the map (data through 13 Oct 2026). Builds on 39 of its 72 references that are in the map. First posted on arXiv 7 Nov 2023.
Builds on
39 of 72 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
- 2022Generative Adversarial Networkscited by 5,614
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,921
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,213
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2017Learning from Synthetic Humanscited by 359
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
27 more
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 118
- 2020Cross-domain Correspondence Learning for Exemplar-based Image Translationcited by 116
- 2019CLOTH3D: Clothed 3D Humanscited by 114
- 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 101
- 2017Detailed, accurate, human shape estimation from clothed 3D scan sequencescited by 89
- 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
- 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
- 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
- 2021Neural Re-Rendering of Humans from a Single Imagecited by 59
- 20193DPeople: Modeling the Geometry of Dressed Humanscited by 58
- 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
- 2018Learning a Shared Shape Space for Multimodal Garment Designcited by 52
- 2021HumanGAN: A Generative Model of Humans Imagescited by 47
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
- 20223D Clothed Human Reconstruction in the Wildcited by 41
- 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
- 2017A Generative Model of People in Clothingcited by 37
- 2021Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstructioncited by 36
- 20213D Human Texture Estimation from a Single Image with Transformerscited by 35
- 2021Generating Datasets of 3D Garments with Sewing Patternscited by 34
- 20203D Human Shape and Pose from a Single Low-Resolution Image with Self-Supervised Learningcited by 28
- 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humanscited by 21
- 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothingcited by 19
- 2022Structure-Preserving 3D Garment Modeling with Neural Sewing Machinescited by 18
Built on by
Citing papers per year: 2023: 2; 2024: 12; 2025: 7; 2026: 12.
33 papers.
Sort:
By area:
- 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidancecited by 43
- 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulationcited by 40
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
- 2024GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patternscited by 27
- 2024Garment3DGen: 3D Garment Stylization and Texture Generationcited by 26
- 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Videocited by 25
- 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Modelscited by 22
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Detailscited by 19
- 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesiscited by 17
- 2024Multimodal Latent Diffusion Model for Complex Sewing Pattern Generationcited by 12
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
- 2025GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformerscited by 9
21 more
- 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editingcited by 6
- 2023SPnet: Estimating Garment Sewing Patterns from a Single Imagecited by 5
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generationcited by 3
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Imagecited by 3
- 2025NGD: Neural Gradient Based Deformation for Monocular Garment Reconstructioncited by 2
- 2026ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment Reconstructioncited by 1
- 2026Learning Sewing Patterns via Latent Flow Matching of Implicit Fieldscited by 1
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformercited by 1
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridgingcited by 1
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garmentscited by 1
- 2024Self-Supervised Vision Transformer for Enhanced Virtual Clothes Try-Oncited by 0
- 2024AIpparel: A Multimodal Foundation Model for Digital Garmentscited by 0
- 2025PhyDeformer: High-Quality Non-Rigid Garment Registration with Physics-Awarenesscited by 0
- 2025Towards Vision-Language-Garment Models for Web Knowledge Garment Understanding and Generationcited by 0
- 2025HoloGarment: 360deg Novel View Synthesis of In-the-Wild Garmentscited by 0
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Drapingcited by 0
- 2026AutoSew: A Geometric Approach to Stitching Prediction with Graph Neural Networkscited by 0
- 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Datacited by 0
- 2026SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representationcited by 0
- 2026FIT: A Large-Scale Dataset for Fit-Aware Virtual Try-Oncited by 0
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patternscited by 0
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026FIT: A Large-Scale Dataset for Fit-Aware Virtual Try-On9 Apr 2026
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridging3 Apr 2026
- 2026SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representation19 Mar 2026
- 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Data9 Mar 2026
- 2026AutoSew: A Geometric Approach to Stitching Prediction with Graph Neural Networks25 Feb 2026
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer12 Feb 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
- 2026Learning Sewing Patterns via Latent Flow Matching of Implicit Fields25 Jan 2026
- 2026ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment Reconstruction23 Jan 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
21 more
- 2025HoloGarment: 360deg Novel View Synthesis of In-the-Wild Garments15 Sep 2025
- 2025NGD: Neural Gradient Based Deformation for Monocular Garment Reconstruction25 Aug 2025
- 2025Towards Vision-Language-Garment Models for Web Knowledge Garment Understanding and Generation5 Jun 2025
- 2025GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers30 Apr 2025
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation29 Apr 2025
- 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing11 Mar 2025
- 2025PhyDeformer: High-Quality Non-Rigid Garment Registration with Physics-Awareness14 Jan 2025
- 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Models23 Dec 2024
- 2024Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation19 Dec 2024
- 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesis11 Dec 2024
- 2024AIpparel: A Multimodal Foundation Model for Digital Garments5 Dec 2024
- 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video12 Sep 2024
- 2024Self-Supervised Vision Transformer for Enhanced Virtual Clothes Try-On15 Jun 2024
- 2024GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patterns27 May 2024
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details20 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models10 Apr 2024
- 2024Garment3DGen: 3D Garment Stylization and Texture Generation27 Mar 2024
- 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidance29 Jan 2024
- 2023SPnet: Estimating Garment Sewing Patterns from a Single Image26 Dec 2023
- 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation20 Nov 2023
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
- 2024Multimodal Latent Diffusion Model for Complex Sewing Pattern Generationcited by 12
- 2025GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformerscited by 9
- 2026Learning Sewing Patterns via Latent Flow Matching of Implicit Fieldscited by 1
- 2024Self-Supervised Vision Transformer for Enhanced Virtual Clothes Try-Oncited by 0
- 2026Learning Sewing Patterns via Latent Flow Matching of Implicit Fields25 Jan 2026
- 2025GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers30 Apr 2025
- 2024Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation19 Dec 2024
- 2024Self-Supervised Vision Transformer for Enhanced Virtual Clothes Try-On15 Jun 2024
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models10 Apr 2024
- 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidancecited by 43
- 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulationcited by 40
- 2024GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patternscited by 27
- 2024Garment3DGen: 3D Garment Stylization and Texture Generationcited by 26
- 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Videocited by 25
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Detailscited by 19
- 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesiscited by 17
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
- 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editingcited by 6
- 2023SPnet: Estimating Garment Sewing Patterns from a Single Imagecited by 5
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generationcited by 3
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Imagecited by 3
12 most cited of 27 All 27 (JSON)
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026FIT: A Large-Scale Dataset for Fit-Aware Virtual Try-On9 Apr 2026
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridging3 Apr 2026
- 2026SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representation19 Mar 2026
- 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Data9 Mar 2026
- 2026AutoSew: A Geometric Approach to Stitching Prediction with Graph Neural Networks25 Feb 2026
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer12 Feb 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
- 2026ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment Reconstruction23 Jan 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
- 2025HoloGarment: 360deg Novel View Synthesis of In-the-Wild Garments15 Sep 2025
12 newest of 27 All 27 (JSON)