mlsanityData to 14 Oct 2026

DNPM: A Neural Parametric Model for the Synthesis of Facial Geometric Details

arXiv 2405.19688 ↗First posted 30 May 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Parametric 3D models have enabled a wide variety of computer vision and graphics tasks, such as modeling human faces, bodies and hands. In 3D face modeling, 3DMM is the most widely used parametric model, but can't generate fine geometric details solely from identity and expression inputs. To tackle this limitation, we propose a neural parametric model named DNPM for the facial geometric details, which utilizes deep neural network to extract latent codes from facial displacement maps encoding details and wrinkles. Built upon DNPM, a novel 3DMM named Detailed3DMM is proposed, which augments traditional 3DMMs by including the synthesis of facial details only from the identity and expression inputs. Moreover, we show that DNPM and Detailed3DMM can facilitate two downstream applications: speech-driven detailed 3D facial animation and 3D face reconstruction from a degraded image. Extensive experiments have shown the usefulness of DNPM and Detailed3DMM, and the progressiveness of two proposed applications.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 30 May 2024.

Builds on

20 of 31 references.

References · 20

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  8. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  9. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  10. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  11. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
  12. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
8 more
  1. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  2. 2021FaceFormer: Speech-Driven 3D Facial Animation with Transformerscited by 209
  3. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  4. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  5. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  6. 2021E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversioncited by 33
  7. 2024Towards a Simultaneous and Granular Identity-Expression Control in Personalized Face Generationcited by 26
  8. 2024Learn2Talk: 3D Talking Face Learns from 2D Talking Facecited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

  1. 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfercited by 3
  2. 2026SemanticFace: Semantic Facial Action Estimation via Semantic Distillation in Interpretable Spacecited by 2
  3. 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customizationcited by 1
  4. 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splattingcited by 0