Volumetric performance capture from minimal camera viewpoints
Not on the map. Why?
Abstract (arXiv)
We present a convolutional autoencoder that enables high fidelity volumetric reconstructions of human performance to be captured from multi-view video comprising only a small set of camera views. Our method yields similar end-to-end reconstruction error to that of a probabilistic visual hull computed using significantly more (double or more) viewpoints. We use a deep prior implicitly learned by the autoencoder trained over a dataset of view-ablated multi-view video footage of a wide range of subjects and actions. This opens up the possibility of high-end volumetric performance capture in on-set and prosumer scenarios where time or cost prohibit a high witness camera count.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 4; 2023: 3; 2024: 3.
17 papers.
Sort:
By area:
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Camerascited by 67
- 2022DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Camerascited by 43
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
- 2021M3D-VTON: A Monocular-to-3D Virtual Try-On Networkcited by 31
- 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstructioncited by 26
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
- 2023SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstructioncited by 15
- 2023Guide3D: Create 3D Avatars from Text and Image Guidancecited by 10
- 2021LightSAL: Lightweight Sign Agnostic Learning for Implicit Surface Representationcited by 7
- 2021Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fieldscited by 5
5 more
- 2023High-Resolution Volumetric Reconstruction for Clothed Humanscited by 5
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2021Temporal Consistency Loss for High Resolution Textured and Clothed 3DHuman Reconstruction from Monocular Videocited by 3
- 2022MVP-Human Dataset for 3D Human Avatar Reconstruction from Unconstrained Framescited by 2
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesiscited by 1
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting13 May 2024
- 2023Guide3D: Create 3D Avatars from Text and Image Guidance18 Aug 2023
- 2023High-Resolution Volumetric Reconstruction for Clothed Humans25 Jul 2023
- 2023SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction1 Apr 2023
- 2022DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras16 Jul 2022
- 2022MVP-Human Dataset for 3D Human Avatar Reconstruction from Unconstrained Frames24 Apr 2022
- 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstruction22 Apr 2022
- 2022Structured Local Radiance Fields for Human Avatar Modeling28 Mar 2022
- 2021Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields23 Dec 2021
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisited17 Aug 2021
5 more
- 2021M3D-VTON: A Monocular-to-3D Virtual Try-On Network11 Aug 2021
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras1 May 2021
- 2021Temporal Consistency Loss for High Resolution Textured and Clothed 3DHuman Reconstruction from Monocular Video19 Apr 2021
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision12 Apr 2021
- 2021LightSAL: Lightweight Sign Agnostic Learning for Implicit Surface Representation26 Mar 2021
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Camerascited by 67
- 2022DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Camerascited by 43
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
- 2021M3D-VTON: A Monocular-to-3D Virtual Try-On Networkcited by 31
- 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstructioncited by 26
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
- 2023SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstructioncited by 15
- 2021LightSAL: Lightweight Sign Agnostic Learning for Implicit Surface Representationcited by 7
- 2021Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fieldscited by 5
- 2023High-Resolution Volumetric Reconstruction for Clothed Humanscited by 5
12 most cited of 15 All 15 (JSON)
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting13 May 2024
- 2023High-Resolution Volumetric Reconstruction for Clothed Humans25 Jul 2023
- 2023SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction1 Apr 2023
- 2022DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras16 Jul 2022
- 2022MVP-Human Dataset for 3D Human Avatar Reconstruction from Unconstrained Frames24 Apr 2022
- 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstruction22 Apr 2022
- 2022Structured Local Radiance Fields for Human Avatar Modeling28 Mar 2022
- 2021Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields23 Dec 2021
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisited17 Aug 2021
- 2021M3D-VTON: A Monocular-to-3D Virtual Try-On Network11 Aug 2021
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras1 May 2021
12 newest of 15 All 15 (JSON)