Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstruction
Not on the map. Why?
Abstract (arXiv)
While single-view 3D reconstruction has made significant progress benefiting from deep shape representations in recent years, garment reconstruction is still not solved well due to open surfaces, diverse topologies and complex geometric details. In this paper, we propose a novel learnable Anchored Unsigned Distance Function (AnchorUDF) representation for 3D garment reconstruction from a single image. AnchorUDF represents 3D shapes by predicting unsigned distance fields (UDFs) to enable open garment surface modeling at arbitrary resolution. To capture diverse garment topologies, AnchorUDF not only computes pixel-aligned local image features of query points, but also leverages a set of anchor points located around the surface to enrich 3D position features for query points, which provides stronger 3D space context for the distance function. Furthermore, in order to obtain more accurate point projection direction at inference, we explicitly align the spatial gradient direction of AnchorUDF with the ground-truth direction to the surface during training. Extensive experiments on two public 3D garment datasets, i.e., MGN and Deep Fashion3D, demonstrate that AnchorUDF achieves the state-of-the-art performance on single-view garment reconstruction.
Key facts. Cited by 36 papers in the map (data through 13 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 19 Aug 2021.
Builds on
33 of 43 references.
References · 33
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,603
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 976
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Implicit Geometric Regularization for Learning Shapescited by 708
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 650
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
21 more
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
- 20163D Shape Induction from 2D Views of Multiple Objectscited by 121
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 118
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 101
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
- 2019SimulCap : Single-View Human Performance Capture with Cloth Simulationcited by 41
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 16; 2024: 7; 2025: 3; 2026: 2.
36 papers.
Sort:
By area:
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 75
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 39
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 33
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologiescited by 27
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 21
- 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physicscited by 19
24 more
- 2022Structure-Preserving 3D Garment Modeling with Neural Sewing Machinescited by 18
- 2023Neural Vector Fields: Implicit Representation by Explicit Learningcited by 16
- 2024Generative AI Models for Different Steps in Architectural Design: A Literature Reviewcited by 12
- 2024Gradient Alignment Improves Test-Time Adaptation for Medical Image Segmentationcited by 11
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scalingcited by 9
- 2024Neural-ABC: Neural Parametric Models for Articulated Body with Clothescited by 9
- 20232S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Imagescited by 7
- 2023Learning Anchor Transformations for 3D Garment Animationcited by 7
- 2023LIST: Learning Implicitly from Spatial Transformers for Single-View 3D Reconstructioncited by 6
- 2023SuperUDF: Self-supervised UDF Estimation for Surface Reconstructioncited by 6
- 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fieldscited by 5
- 2023High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videoscited by 5
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Drapingcited by 4
- 2023Neural Vector Fields: Generalizing Distance Vector Fields by Codebooks and Zero-Curl Regularizationcited by 2
- 2023DeepIron: Predicting Unwarped Garment Texture from a Single Imagecited by 2
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detailcited by 2
- 2025High Resolution UDF Meshing via Iterative Networkscited by 2
- 2022Automated Reconstruction of 3D Open Surfaces from Sparse Point Cloudscited by 1
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstructioncited by 0
- 2024Gradient Distance Functioncited by 0
- 2025Neural Shortest Path for Surface Reconstruction from Point Cloudscited by 0
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Drapingcited by 0
- 2026SewFusion: Tailored Generation of Topology and Panel-Level Geometry for Sewing Patternscited by 0
- 2026SewFusion: Tailored Generation of Topology and Panel-Level Geometry for Sewing Patterns20 Sep 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics5 Feb 2025
- 2024Gradient Distance Function29 Oct 2024
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detail10 Sep 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Gradient Alignment Improves Test-Time Adaptation for Medical Image Segmentation14 Aug 2024
- 2024Neural-ABC: Neural Parametric Models for Articulated Body with Clothes6 Apr 2024
- 2024Generative AI Models for Different Steps in Architectural Design: A Literature Review30 Mar 2024
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling14 Feb 2024
24 more
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Image7 Nov 2023
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Draping5 Nov 2023
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstruction5 Nov 2023
- 2023High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videos2 Nov 2023
- 2023DeepIron: Predicting Unwarped Garment Texture from a Single Image24 Oct 2023
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Covering5 Oct 2023
- 2023Learning Disentangled Avatars with Hybrid 3D Representations12 Sep 2023
- 2023Neural Vector Fields: Generalizing Distance Vector Fields by Codebooks and Zero-Curl Regularization4 Sep 2023
- 2023SuperUDF: Self-supervised UDF Estimation for Surface Reconstruction28 Aug 2023
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projection22 Aug 2023
- 2023LIST: Learning Implicitly from Spatial Transformers for Single-View 3D Reconstruction23 Jul 2023
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videos23 May 2023
- 2023Learning Anchor Transformations for 3D Garment Animation3 Apr 2023
- 20232S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Images27 Mar 2023
- 2023Neural Vector Fields: Implicit Representation by Explicit Learning8 Mar 2023
- 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fields1 Mar 2023
- 2022DrapeNet: Garment Generation and Self-Supervised Draping21 Nov 2022
- 2022Structure-Preserving 3D Garment Modeling with Neural Sewing Machines12 Nov 2022
- 2022Automated Reconstruction of 3D Open Surfaces from Sparse Point Clouds26 Oct 2022
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimization6 Oct 2022
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologies31 May 2022
- 2022GIFS: Neural Implicit Function for General Shape Representation14 Apr 2022
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB image5 Apr 2022
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks29 Nov 2021
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 75
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 39
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 33
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologiescited by 27
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 21
- 2022Structure-Preserving 3D Garment Modeling with Neural Sewing Machinescited by 18
12 most cited of 34 All 34 (JSON)
- 2026SewFusion: Tailored Generation of Topology and Panel-Level Geometry for Sewing Patterns20 Sep 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2024Gradient Distance Function29 Oct 2024
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detail10 Sep 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024Gradient Alignment Improves Test-Time Adaptation for Medical Image Segmentation14 Aug 2024
- 2024Neural-ABC: Neural Parametric Models for Articulated Body with Clothes6 Apr 2024
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling14 Feb 2024
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Image7 Nov 2023
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Draping5 Nov 2023
12 newest of 34 All 34 (JSON)