Learning Implicit Templates for Point-Based Clothed Human Modeling
Not on the map. Why?
Abstract (arXiv)
We present FITE, a First-Implicit-Then-Explicit framework for modeling human avatars in clothing. Our framework first learns implicit surface templates representing the coarse clothing topology, and then employs the templates to guide the generation of point sets which further capture pose-dependent clothing deformations such as wrinkles. Our pipeline incorporates the merits of both implicit and explicit representations, namely, the ability to handle varying topology and the ability to efficiently capture fine details. We also propose diffused skinning to facilitate template training especially for loose clothing, and projection-based pose-encoding to extract pose information from mesh templates without predefined UV map or connectivity. Our code is publicly available at https://github.com/jsnln/fite.
Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Builds on 49 of its 68 references that are in the map. First posted on arXiv 14 Jul 2022.
Builds on
49 of 68 references.
References · 49
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Convolutional Occupancy Networkscited by 761
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
37 more
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 149
- 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2019Learning elementary structures for 3D shape generation and matchingcited by 98
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2019Learning-Based Animation of Clothing for Virtual Try-Oncited by 89
- 2020Discrete Point Flow Networks for Efficient Point Cloud Generationcited by 87
- 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
- 2020Deep Implicit Templates for 3D Shape Representationcited by 86
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2018GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Drapingcited by 69
- 2020DeepCloth: Neural Garment Representation for Shape and Style Editingcited by 54
- 2020Human Mesh Recovery from Multiple Shotscited by 52
- 2020Fully Convolutional Graph Neural Networks for Parametric Virtual Try-Oncited by 48
- 2021Dynamic Surface Function Networks for Clothed Human Bodiescited by 44
- 2019Shape Reconstruction by Learning Differentiable Surface Representationscited by 37
- 2021Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Camerascited by 33
- 2020Better Patch Stitching for Parametric Surface Reconstructioncited by 21
Built on by
Citing papers per year: 2022: 6; 2023: 19; 2024: 9; 2025: 7; 2026: 9.
50 papers.
Sort:
By area:
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 78
- 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2023Dynamic Point Fieldscited by 37
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
38 more
- 2024MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videoscited by 34
- 2023Human101: Training 100+FPS Human Gaussians in 100s from 1 Viewcited by 32
- 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Priorcited by 31
- 2022Neural Point-based Shape Modeling of Humans in Challenging Clothingcited by 29
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
- 2023Animatable and Relightable Gaussians for High-fidelity Human Avatar Modelingcited by 27
- 2024LayGA: Layered Gaussian Avatars for Animatable Clothing Transfercited by 22
- 2024GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Viewscited by 22
- 2023CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decompositioncited by 21
- 2023NSF: Neural Surface Fields for Human Modeling from Monocular Depthcited by 21
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
- 2022Structure-Preserving 3D Garment Modeling with Neural Sewing Machinescited by 18
- 2023SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstructioncited by 15
- 2025RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Imagescited by 12
- 2023Guide3D: Create 3D Avatars from Text and Image Guidancecited by 10
- 2023Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Imagescited by 8
- 2023Leveraging Intrinsic Properties for Non-Rigid Garment Alignmentcited by 6
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3Dcited by 6
- 2024TexVocab: Texture Vocabulary-conditioned Human Avatarscited by 4
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Imagescited by 4
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignmentcited by 3
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretrainingcited by 3
- 2023DLCA-Recon: Dynamic Loose Clothing Avatar Reconstruction from Monocular Videoscited by 2
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modelingcited by 2
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-Oncited by 2
- 2026Visually-grounded Humanoid Agentscited by 2
- 2023Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Mapscited by 1
- 2024A Comparative Study of Garment Draping Techniquescited by 1
- 20252DGS-Avatar: Animatable High-fidelity Clothed Avatar via 2D Gaussian Splattingcited by 1
- 2024Garment Animation NeRF with Color Editingcited by 0
- 2024InstantGeoAvatar: Effective Geometry and Appearance Modeling of Animatable Avatars from Monocular Videocited by 0
- 2025Physically Plausible Human-Object Rendering from Sparse Views via 3D Gaussian Splattingcited by 0
- 2026Patch-based Representation and Learning for Efficient Deformation Modelingcited by 0
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animationcited by 0
- 2026Autoregressive Appearance Prediction for 3D Gaussian Avatarscited by 0
- 2026Rendering Multi-Human and Multi-Object with 3D Gaussian Splattingcited by 0
- 2026MUA: Mobile Ultra-detailed Animatable Avatarscited by 0
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformerscited by 0
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformers16 Sep 2026
- 2026MUA: Mobile Ultra-detailed Animatable Avatars20 Apr 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026Rendering Multi-Human and Multi-Object with 3D Gaussian Splatting3 Apr 2026
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining2 Apr 2026
- 2026Autoregressive Appearance Prediction for 3D Gaussian Avatars1 Apr 2026
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation26 Mar 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026Patch-based Representation and Learning for Efficient Deformation Modeling8 Jan 2026
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3D16 Jun 2025
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment2 Jun 2025
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Images24 Mar 2025
38 more
- 2025RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Images18 Mar 2025
- 2025Physically Plausible Human-Object Rendering from Sparse Views via 3D Gaussian Splatting12 Mar 2025
- 20252DGS-Avatar: Animatable High-fidelity Clothed Avatar via 2D Gaussian Splatting4 Mar 2025
- 2025Vid2Avatar-Pro: Authentic Avatar from Videos in the Wild via Universal Prior3 Mar 2025
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction3 Dec 2024
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling29 Nov 2024
- 2024GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Views18 Nov 2024
- 2024InstantGeoAvatar: Effective Geometry and Appearance Modeling of Animatable Avatars from Monocular Video3 Nov 2024
- 2024Garment Animation NeRF with Color Editing29 Jul 2024
- 2024MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videos11 Jul 2024
- 2024A Comparative Study of Garment Draping Techniques17 May 2024
- 2024LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer12 May 2024
- 2024TexVocab: Texture Vocabulary-conditioned Human Avatars31 Mar 2024
- 2023Human101: Training 100+FPS Human Gaussians in 100s from 1 View23 Dec 2023
- 2023DLCA-Recon: Dynamic Loose Clothing Avatar Reconstruction from Monocular Videos19 Dec 2023
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering10 Dec 2023
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis4 Dec 2023
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians4 Dec 2023
- 2023Animatable and Relightable Gaussians for High-fidelity Human Avatar Modeling27 Nov 2023
- 2023Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Maps27 Nov 2023
- 2023Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Images6 Nov 2023
- 2023NSF: Neural Surface Fields for Human Modeling from Monocular Depth28 Aug 2023
- 2023Guide3D: Create 3D Avatars from Text and Image Guidance18 Aug 2023
- 2023Leveraging Intrinsic Properties for Non-Rigid Garment Alignment18 Aug 2023
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatars11 Aug 2023
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videos23 May 2023
- 2023AvatarReX: Real-time Expressive Full-body Avatars8 May 2023
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modeling25 Apr 2023
- 2023CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decomposition6 Apr 2023
- 2023Dynamic Point Fields5 Apr 2023
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos4 Apr 2023
- 2023SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction1 Apr 2023
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds20 Dec 2022
- 2022PointAvatar: Deformable Point-based Head Avatars from Videos16 Dec 2022
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics14 Dec 2022
- 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fields28 Nov 2022
- 2022Structure-Preserving 3D Garment Modeling with Neural Sewing Machines12 Nov 2022
- 2022Neural Point-based Shape Modeling of Humans in Challenging Clothing14 Sep 2022
- 2023Guide3D: Create 3D Avatars from Text and Image Guidancecited by 10
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformerscited by 0
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformers16 Sep 2026
- 2023Guide3D: Create 3D Avatars from Text and Image Guidance18 Aug 2023
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 78
- 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2023Dynamic Point Fieldscited by 37
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
12 most cited of 48 All 48 (JSON)
- 2026MUA: Mobile Ultra-detailed Animatable Avatars20 Apr 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026Rendering Multi-Human and Multi-Object with 3D Gaussian Splatting3 Apr 2026
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining2 Apr 2026
- 2026Autoregressive Appearance Prediction for 3D Gaussian Avatars1 Apr 2026
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation26 Mar 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026Patch-based Representation and Learning for Efficient Deformation Modeling8 Jan 2026
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3D16 Jun 2025
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment2 Jun 2025
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Images24 Mar 2025
- 2025RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Images18 Mar 2025
12 newest of 48 All 48 (JSON)