mlsanityData to 7 Oct 2026

Profile-Specific 3DMM Regression from a Single Lateral Face Image

arXiv 2605.01746 ↗First posted 3 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Single-image 3D face reconstruction is a core problem in computer vision, with important clinical applications such as cephalometric landmark analysis in orthodontics. Traditionally, this analysis relies on lateral X-ray imaging; however, frequent X-ray exposure is impractical due to radiation concerns. While recent research has explored detecting landmarks from lateral RGB images as an alternative, existing methods typically rely on 2D features such as the eyes, mouth, ears, and boundary silhouettes, failing to fully exploit the underlying 3D facial geometry spanning the facial profile and jawline, which is essential for accurate diagnosis. Meanwhile, although 3D face reconstruction from frontal views has seen significant progress, most learning-based 3D morphable model (3DMM) regressors are developed and benchmarked on near-frontal images, where appearance cues are abundant. In extreme profile views (yaw ≈ 90^circ), much of the face is occluded, and the available signal is dominated by boundary cues, making accurate 3D reconstruction challenging. In this paper, we bridge this gap with geometry-conditioned synthetic data and a simple profile-specific FLAME regression baseline for single lateral images. We introduce ProfileSynth, a dataset created by sampling FLAME shape and pose parameters in extreme yaw ranges and generating photorealistic profile images using a diffusion model conditioned on depth and normal maps. We further study a profile-specific baseline with visibility-aware jawline regularization. Our framework provides a practical baseline for "profile × 3DMM" reconstruction and a promising foundation for more accurate, non-invasive cephalometric analysis from lateral RGB images.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 3 May 2026.

Builds on

22 of 40 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  5. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  6. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  7. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  8. 2017Neural 3D Mesh Renderercited by 437
  9. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  10. 20193D Morphable Face Models -- Past, Present and Futurecited by 269
  11. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  12. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
10 more
  1. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  2. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  3. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  4. 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
  5. 2022Towards Metrical Reconstruction of Human Facescited by 165
  6. 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
  7. 2022REALY: Rethinking the Evaluation of 3D Face Reconstructioncited by 32
  8. 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
  9. 2021Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometrycited by 27
  10. 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Fake It Without Making It: Conditioned Face Generation for Accurate 3D Face Reconstruction
  2. 20173D Face Reconstruction with Geometry Details from a Single Image
  3. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Heads
  4. 2024OFER: Occluded Face Expression Reconstruction
  5. 2026Cranio-Diff: Diffusion-based Cross-domain Craniofacial Reconstruction with 2D X-ray Skull Guidance and Structural Identity Constraints
  6. 2025StyleMM: Stylized 3D Morphable Face Model via Text-Driven Aligned Image Translation
  7. 2024Towards Multi-domain Face Landmark Detection with Synthetic Data from Diffusion model
  8. 2023FitDiff: Robust monocular 3D facial shape and reflectance estimation using Diffusion Models