mlsanityData to 14 Oct 2026

Disjoint Pose and Shape for 3D Face Reconstruction

arXiv 2308.13903 ↗First posted 26 Aug 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS), on the other hand, uses dozens of high-resolution images to reconstruct accurate 3D faces.However, it produces noisy and stretched-out results with only two views available. In this paper, taking inspiration from both these methods, we propose an end-to-end pipeline that disjointly solves for pose and shape to make the optimization stable and accurate. We use a face shape prior to estimate face pose and use stereo matching followed by a 3DMM to solve for the shape. The proposed method achieves end-to-end topological consistency, enables iterative face pose refinement procedure, and show remarkable improvement on both quantitative and qualitative results over existing state-of-the-art methods.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 20 of its 53 references that are in the map. First posted on arXiv 26 Aug 2023.

Builds on

20 of 53 references.

References · 20

  1. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
  2. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  3. 20193D Morphable Face Models -- Past, Present and Futurecited by 270
  4. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  5. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  6. 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
  7. 2018Nonlinear 3D Face Morphable Modelcited by 157
  8. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  9. 2019Point-Based Multi-View Stereo Networkcited by 147
  10. 2016Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Networkcited by 109
  11. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  12. 2019BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUscited by 74
8 more
  1. 20223D face reconstruction with dense landmarkscited by 70
  2. 2018On Learning 3D Face Morphable Model from In-the-wild Imagescited by 54
  3. 2019MVF-Net: Multi-View 3D Face Morphable Model Regressioncited by 45
  4. 2019Pyramid Multi-view Stereo Net with Self-adaptive View Aggregationcited by 44
  5. 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
  6. 2021Riggable 3D Face Reconstruction via In-Network Optimizationcited by 31
  7. 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
  8. 2017Learned Multi-Patch Similaritycited by 24

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.

  1. 2024Few-shot Novel View Synthesis using Depth Aware 3D Gaussian Splattingcited by 10
  2. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  3. 2024SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surfacecited by 7