# Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs

arXiv: https://arxiv.org/abs/1907.06724 · HTML: https://mlsanity.com/paper/1907.06724/

## Key facts

- Cited by 73 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Jul 2019.

## Built on by (most cited first, 30 of 73)

- [Generating Holistic 3D Human Motion from Speech](https://mlsanity.com/paper/2212.04420/) (2022)
- [Towards Metrical Reconstruction of Human Faces](https://mlsanity.com/paper/2204.06607/) (2022)
- [3D face reconstruction with dense landmarks](https://mlsanity.com/paper/2204.02776/) (2022)
- [LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization](https://mlsanity.com/paper/2106.04185/) (2021)
- [HeadSculpt: Crafting 3D Head Avatars with Text](https://mlsanity.com/paper/2306.03038/) (2023)
- [3D Face Reconstruction with the Geometric Guidance of Facial Part Segmentation](https://mlsanity.com/paper/2312.00311/) (2023)
- [SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark](https://mlsanity.com/paper/2310.20436/) (2023)
- [Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluation](https://mlsanity.com/paper/2308.05441/) (2023)
- [LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis](https://mlsanity.com/paper/2308.10713/) (2023)
- [DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformer](https://mlsanity.com/paper/2406.09622/) (2024)
- [Real-time RGBD-based Extended Body Pose Estimation](https://mlsanity.com/paper/2103.03663/) (2021)
- [GANonymization: A GAN-based Face Anonymization Framework for Preserving Emotional Expressions](https://mlsanity.com/paper/2305.02143/) (2023)
- [PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring](https://mlsanity.com/paper/2507.19172/) (2025)
- [Unsupervised High-Fidelity Facial Texture Generation and Reconstruction](https://mlsanity.com/paper/2110.04760/) (2021)
- [MSPM: A Multi-Site Physiological Monitoring Dataset for Remote Pulse, Respiration, and Blood Pressure Estimation](https://mlsanity.com/paper/2402.02224/) (2024)
- [Universal computational thermal imaging overcoming the ghosting effect](https://mlsanity.com/paper/2604.01542/) (2026)
- [Intelligent Sight and Sound: A Chronic Cancer Pain Dataset](https://mlsanity.com/paper/2204.04214/) (2022)
- [PhysFlow: Skin tone transfer for remote heart rate estimation through conditional normalizing flows](https://mlsanity.com/paper/2407.21519/) (2024)
- [Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videos](https://mlsanity.com/paper/2508.00748/) (2025)
- [Real-time Driver Monitoring Systems on Edge AI Device](https://mlsanity.com/paper/2304.01555/) (2023)
- [NeRF-AD: Neural Radiance Field with Attention-based Disentanglement for Talking Face Synthesis](https://mlsanity.com/paper/2401.12568/) (2024)
- [Deep adaptative spectral zoom for improved remote heart rate estimation](https://mlsanity.com/paper/2403.06902/) (2024)
- [Evaluation of Video-Based rPPG in Challenging Environments: Artifact Mitigation and Network Resilience](https://mlsanity.com/paper/2405.01230/) (2024)
- [Learning Gaze-aware Compositional GAN](https://mlsanity.com/paper/2405.20643/) (2024)
- [Open-Source Periorbital Segmentation Dataset for Ophthalmic Applications](https://mlsanity.com/paper/2409.20407/) (2024)
- [A Bridge from Audio to Video: Phoneme-Viseme Alignment Allows Every Face to Speak Multiple Languages](https://mlsanity.com/paper/2510.06612/) (2025)
- [SemanticFace: Semantic Facial Action Estimation via Semantic Distillation in Interpretable Space](https://mlsanity.com/paper/2603.14827/) (2026)
- [Hiding Your Signals: A Security Analysis of PPG-based Biometric Authentication](https://mlsanity.com/paper/2207.04434/) (2022)
- [Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairs](https://mlsanity.com/paper/2306.06505/) (2023)
- [A lightweight 3D dense facial landmark estimation model from position map data](https://mlsanity.com/paper/2308.15170/) (2023)

## Abstract (arXiv)

We present an end-to-end neural network-based model for inferring an approximate 3D mesh representation of a human face from single camera input for AR applications. The relatively dense mesh model of 468 vertices is well-suited for face-based AR effects. The proposed model demonstrates super-realtime inference speed on mobile GPUs (100-1000+ FPS, depending on the device and model variant) and a high prediction quality that is comparable to the variance in manual annotations of the same image.