Revisiting an Old Perspective Projection for Monocular 3D Morphable Models Regression
Not on the map. Why?
Abstract (arXiv)
We introduce a novel camera model for monocular 3D Morphable Model (3DMM) regression methods that effectively captures the perspective distortion effect commonly seen in close-up facial images. Fitting 3D morphable models to video is a key technique in content creation. In particular, regression-based approaches have produced fast and accurate results by matching the rendered output of the morphable model to the target image. These methods typically achieve stable performance with orthographic projection, which eliminates the ambiguity between focal length and object distance. However, this simplification makes them unsuitable for close-up footage, such as that captured with head-mounted cameras. We extend orthographic projection with a new shrinkage parameter, incorporating a pseudo-perspective effect while preserving the stability of the original projection. We present several techniques that allow finetuning of existing models, and demonstrate the effectiveness of our modification through both quantitative and qualitative comparisons using a custom dataset recorded with head-mounted cameras.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
17 of 26 references.
References · 17
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
- 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 90
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 20223D face reconstruction with dense landmarkscited by 70
- 2022Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videoscited by 50
5 more
- 20173D Face Morphable Models "In-the-Wild"cited by 44
- 2021Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstructioncited by 33
- 2024Look Ma, no markers: holistic performance capture without the hasslecited by 23
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2015Fitting 3D Morphable Models using Local Featurescited by 6
Built on by
Not cited yet.