Video Based Reconstruction of 3D People Models
Not on the map. Why?
Abstract (arXiv)
This paper describes how to obtain accurate 3D body models and texture of arbitrary people from a single, monocular video in which a person is moving. Based on a parametric body model, we present a robust processing pipeline achieving 3D model fits with 5mm accuracy also for clothed people. Our main contribution is a method to nonrigidly deform the silhouette cones corresponding to the dynamic human silhouettes, resulting in a visual hull in a common reference frame that enables surface reconstruction. This enables efficient estimation of a consensus 3D shape, texture and implanted animation skeleton based on a large number of frames. We present evaluation results for a number of test subjects and analyze overall performance. Requiring only a smartphone or webcam, our method enables everyone to create their own fully animatable digital double, e.g., for social VR applications or virtual try-on for online fashion shopping.
Key facts. Cited by 237 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 47; 2023: 52; 2024: 53; 2025: 33; 2026: 14.
237 papers.
Sort:
By area:
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
38 more
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2021Real-time Deep Dynamic Characterscited by 133
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2021Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothingcited by 102
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
- 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2023Hi4D: 4D Instance Segmentation of Close Human Interactioncited by 87
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
- 2021Driving-Signal Aware Full-Body Avatarscited by 81
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2023X-Avatar: Expressive Human Avatarscited by 66
- 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
50 most cited of 237 All 237 (JSON)
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction28 Jun 2026
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026Better Rigs, Not Bigger Networks: A Body Model Ablation for Gaussian Avatars1 Apr 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026PoseGaussian: Pose-Driven Novel View Synthesis for Robust 3D Human Reconstruction5 Feb 2026
- 2026VRGaussianAvatar: Integrating 3D Gaussian Avatars into VR2 Feb 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
38 more
- 2026InpaintHuman: Reconstructing Occluded Humans with Multi-Scale UV Mapping and Identity-Preserving Diffusion Inpainting5 Jan 2026
- 2026Animated 3DGS Avatars in Diverse Scenes with Consistent Lighting and Shadows4 Jan 2026
- 2025ViSA: 3D-Aware Video Shading for Real-Time Upper-Body Avatar Creation8 Dec 2025
- 2025Tessellation GS: Neural Mesh Gaussians for Robust Monocular Reconstruction of Dynamic Objects8 Dec 2025
- 2025Frequency-Decomposed Avatar Representation for Varying Camera Distances3 Dec 2025
- 2025AHA! Animating Human Avatars in Diverse Scenes with Gaussian Splatting13 Nov 2025
- 2025FMGS-Avatar: Mesh-Guided 2D Gaussian Splatting with Foundation Model Priors for 3D Monocular Avatar Reconstruction18 Sep 2025
- 2025Dream3DAvatar: Text-Controlled 3D Avatar Reconstruction from a Single Image16 Sep 2025
- 2025On the Skinning of Gaussian Avatars14 Sep 2025
- 2025NGD: Neural Gradient Based Deformation for Monocular Garment Reconstruction25 Aug 2025
- 2025MExECON: Multi-view Extended Explicit Clothed humans Optimized via Normal integration21 Aug 2025
- 2025PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image13 Aug 2025
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Learning Efficient and Generalizable Human Representation with Human Gaussian Model24 Jul 2025
- 2025EPSilon: Efficient Point Sampling for Lightening of Hybrid-based 3D Avatar Generation18 Jul 2025
- 2025DeOcc-1-to-3: 3D De-Occlusion from a Single Image via Self-Supervised Multi-View Diffusion26 Jun 2025
- 2025Fetuses Made Simple: Modeling and Tracking of Fetal Shape and Pose21 Jun 2025
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3D16 Jun 2025
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation8 May 2025
- 2025S3D: Sketch-Driven 3D Model Generation7 May 2025
- 2025SignSplat: Rendering Sign Language via Gaussian Splatting4 May 2025
- 2025Real-Time Animatable 2DGS-Avatars with Detail Enhancement from Monocular Videos1 May 2025
- 2025SMPL-GPTexture: Dual-View 3D Human Texture Estimation using Text-to-Image Generation Models17 Apr 2025
- 2025GSAC: Leveraging Gaussian Splatting for Photorealistic Avatar Creation with Unity Integration17 Apr 2025
- 2025DNF-Avatar: Distilling Neural Fields for Real-time Animatable Avatar Relighting14 Apr 2025
- 2025Exploring Disentangled and Controllable Human Image Synthesis: From End-to-End to Stage-by-Stage25 Mar 2025
- 2025TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting21 Mar 2025
- 2025Advances in 4D Generation: A Survey18 Mar 2025
- 2025R3-Avatar: Record and Retrieve Temporal Codebook for Reconstructing Photorealistic Human Avatars17 Mar 2025
- 2025GASPACHO: Gaussian Splatting for Controllable Humans and Objects12 Mar 2025
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformation24 Feb 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2025WonderHuman: Hallucinating Unseen Parts in Dynamic 3D Human Reconstruction3 Feb 2025
- 2025RMAvatar: Photorealistic Human Avatar Reconstruction from Monocular Video Based on Rectified Mesh-embedded Gaussians13 Jan 2025
- 2024SqueezeMe: Mobile-Ready Distillation of Gaussian Full-Body Avatars19 Dec 2024
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024NF3DM: Combining Neural Fields and Deformation Models for 3D Non-Rigid Motion Reconstruction11 Dec 2024
50 newest of 237 All 237 (JSON)
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatarscited by 28
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
- 2024Instant 3D Human Avatar Generation using Image Diffusion Modelscited by 14
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstructioncited by 8
- 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
- 2024Synthesizing Moving People with 3D Controlcited by 5
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentationcited by 2
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul 2025
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation8 May 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models11 Jun 2024
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar 2024
- 2024Synthesizing Moving People with 3D Control19 Jan 2024
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars16 Mar 2023
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
12 most cited of 226 All 226 (JSON)
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction28 Jun 2026
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026Better Rigs, Not Bigger Networks: A Body Model Ablation for Gaussian Avatars1 Apr 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026PoseGaussian: Pose-Driven Novel View Synthesis for Robust 3D Human Reconstruction5 Feb 2026
- 2026VRGaussianAvatar: Integrating 3D Gaussian Avatars into VR2 Feb 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
- 2026InpaintHuman: Reconstructing Occluded Humans with Multi-Scale UV Mapping and Identity-Preserving Diffusion Inpainting5 Jan 2026
12 newest of 226 All 226 (JSON)