mlsanityData to 14 Oct 2026

GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing

arXiv 2503.08678 ↗First posted 11 Mar 2025cs.GR cs.AI cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

We introduce GarmentCrafter, a new approach that enables non-professional users to create and modify 3D garments from a single-view image. While recent advances in image generation have facilitated 2D garment design, creating and editing 3D garments remains challenging for non-professional users. Existing methods for single-view 3D reconstruction often rely on pre-trained generative models to synthesize novel views conditioning on the reference image and camera pose, yet they lack cross-view consistency, failing to capture the internal relationships across different views. In this paper, we tackle this challenge through progressive depth prediction and image warping to approximate novel views. Subsequently, we train a multi-view diffusion model to complete occluded and unknown clothing regions, informed by the evolving camera pose. By jointly inferring RGB and depth, GarmentCrafter enforces inter-view coherence and reconstructs precise geometries and fine details. Extensive experiments demonstrate that our method achieves superior visual fidelity and inter-view coherence compared to state-of-the-art single-view 3D garment reconstruction methods.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 68 of its 90 references that are in the map. First posted on arXiv 11 Mar 2025.

Builds on

68 of 90 references.

References · 68

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  11. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
38 more
  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  2. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  3. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  4. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  5. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  6. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  7. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  8. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  9. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  10. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  11. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  12. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  13. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  14. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  15. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  16. 2022Novel View Synthesis with Diffusion Modelscited by 300
  17. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  18. 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
  19. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
  20. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
  21. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  22. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  23. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  24. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
  25. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  26. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  27. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  28. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  29. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  30. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
  31. 2023HUGS: Human Gaussian Splatscited by 154
  32. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  33. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  34. 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
  35. 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
  36. 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
  37. 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
  38. 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates
  2. 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
  3. 2026Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates
  4. 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model
  5. 2026DressWild: Feed-Forward Pose-Agnostic Garment Sewing Pattern Generation from In-the-Wild Images
  6. 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments
  7. 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics
  8. 2026Image2Garment: Simulation-ready Garment Generation from a Single Image