# High Accuracy Face Geometry Capture using a Smartphone Video

arXiv: https://arxiv.org/abs/2003.08583 · HTML: https://mlsanity.com/paper/2003.08583/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Mar 2020.

## Built on by (most cited first, 2 of 2)

- [Prior-Guided Multi-View 3D Head Reconstruction](https://mlsanity.com/paper/2107.04277/) (2021)
- [Single-Camera 3D Head Fitting for Mixed Reality Clinical Applications](https://mlsanity.com/paper/2109.02740/) (2021)

## Abstract (arXiv)

What's the most accurate 3D model of your face you can obtain while sitting at your desk? We attempt to answer this question in our work. High fidelity face reconstructions have so far been limited to either studio settings or through expensive 3D scanners. On the other hand, unconstrained reconstruction methods are typically limited by low-capacity models. Our method reconstructs accurate face geometry of a subject using a video shot from a smartphone in an unconstrained environment. Our approach takes advantage of recent advances in visual SLAM, keypoint detection, and object detection to improve accuracy and robustness. By not being constrained to a model subspace, our reconstructed meshes capture important details while being robust to noise and being topologically consistent. Our evaluations show that our method outperforms current single and multi-view baselines by a significant margin, both in terms of geometric accuracy and in capturing person-specific details important for making realistic looking models.