mlsanityData to 14 Oct 2026

High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videos

arXiv 2311.01214 ↗First posted 2 Nov 2023cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Much progress has been made in reconstructing garments from an image or a video. However, none of existing works meet the expectations of digitizing high-quality animatable dynamic garments that can be adjusted to various unseen poses. In this paper, we propose the first method to recover high-quality animatable dynamic garments from monocular videos without depending on scanned data. To generate reasonable deformations for various unseen poses, we propose a learnable garment deformation network that formulates the garment reconstruction task as a pose-driven deformation problem. To alleviate the ambiguity estimating 3D garments from monocular videos, we design a multi-hypothesis deformation module that learns spatial representations of multiple plausible deformations. Experimental results on several public datasets demonstrate that our method can reconstruct high-quality dynamic garments with coherent surface details, which can be easily animated under unseen poses. The code will be provided for research purposes.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 54 of its 79 references that are in the map. First posted on arXiv 2 Nov 2023.

Builds on

54 of 79 references.

References · 54

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  4. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  5. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  8. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  9. 2019Neural Point-Based Graphicscited by 327
  10. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  11. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  12. 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
38 more
  1. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  2. 2018Video Based Reconstruction of 3D People Modelscited by 238
  3. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  4. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  5. 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
  6. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  7. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  8. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  9. 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
  10. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  11. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
  12. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  13. 2018Instance-level Human Parsing via Part Grouping Networkcited by 134
  14. 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
  15. 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
  16. 2018Detailed Human Avatars from Monocular Videocited by 109
  17. 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
  18. 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
  19. 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
  20. 2017Detailed, accurate, human shape estimation from clothed 3D scan sequencescited by 89
  21. 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
  22. 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
  23. 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
  24. 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
  25. 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
  26. 2020SMPLpix: Neural Avatars from 3D Human Modelscited by 69
  27. 2020PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformationcited by 63
  28. 2019Learning single-image 3D reconstruction by generative modelling of shape, pose and shadingcited by 43
  29. 20223D Clothed Human Reconstruction in the Wildcited by 42
  30. 2022Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Imagescited by 39
  31. 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
  32. 2021Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstructioncited by 36
  33. 2020Deep Physics-aware Inference of Cloth Deformation for Monocular Human Performance Capturecited by 30
  34. 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
  35. 2022FOF: Learning Fourier Occupancy Field for Monocular Real-time Human Reconstructioncited by 27
  36. 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstructioncited by 26
  37. 2019TightCap: 3D Human Shape Capture with Clothing Tightness Fieldcited by 25
  38. 2022AvatarCap: Animatable Avatar Conditioned Monocular Human Volumetric Capturecited by 25

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 2; 2026: 1.

5 papers.

  1. 2024UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modelingcited by 17
  2. 2025Point2Quad: Generating Quad Meshes from Point Clouds via Face Predictioncited by 5
  3. 2023SpeechAct: Towards Generating Whole-body Motion from Speechcited by 4
  4. 2025NGD: Neural Gradient Based Deformation for Monocular Garment Reconstructioncited by 2
  5. 2026Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinatescited by 0