GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing
Not on the map. Why?
Abstract (arXiv)
We introduce GarmentCrafter, a new approach that enables non-professional users to create and modify 3D garments from a single-view image. While recent advances in image generation have facilitated 2D garment design, creating and editing 3D garments remains challenging for non-professional users. Existing methods for single-view 3D reconstruction often rely on pre-trained generative models to synthesize novel views conditioning on the reference image and camera pose, yet they lack cross-view consistency, failing to capture the internal relationships across different views. In this paper, we tackle this challenge through progressive depth prediction and image warping to approximate novel views. Subsequently, we train a multi-view diffusion model to complete occluded and unknown clothing regions, informed by the evolving camera pose. By jointly inferring RGB and depth, GarmentCrafter enforces inter-view coherence and reconstructs precise geometries and fine details. Extensive experiments demonstrate that our method achieves superior visual fidelity and inter-view coherence compared to state-of-the-art single-view 3D garment reconstruction methods.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 68 of its 90 references that are in the map. First posted on arXiv 11 Mar 2025.
Builds on
68 of 90 references.
References · 68
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
38 more
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2022Novel View Synthesis with Diffusion Modelscited by 300
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2023WonderJourney: Going from Anywhere to Everywherecited by 158
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
- 2023HUGS: Human Gaussian Splatscited by 154
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatarscited by 2
- 2026SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representationcited by 0
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animationcited by 0
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patternscited by 0
- 2026SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objectscited by 0
- 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstructioncited by 0
- 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction24 Sep 2026
- 2026SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objects19 Aug 2026
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation26 Mar 2026
- 2026SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representation19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
- 2026Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates
- 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model
- 2026DressWild: Feed-Forward Pose-Agnostic Garment Sewing Pattern Generation from In-the-Wild Images
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments
- 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image