Photo-Realistic Facial Details Synthesis from Single Image
Not on the map. Why?
Abstract (arXiv)
We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression analysis for proxy face geometry generation and combines supervised and unsupervised learning for facial detail synthesis. On proxy generation, we conduct emotion prediction to determine a new expression-informed proxy. On detail synthesis, we present a Deep Facial Detail Net (DFDN) based on Conditional Generative Adversarial Net (CGAN) that employs both geometry and appearance loss functions. For geometry, we capture 366 high-quality 3D scans from 122 different subjects under 3 facial expressions. For appearance, we use additional 20K in-the-wild face images and apply image-based rendering to accommodate lighting variations. Comprehensive experiments demonstrate that our framework can produce high-quality 3D faces with realistic details under challenging facial expressions.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 9; 2024: 3; 2025: 4; 2026: 1.
40 papers.
Sort:
By area:
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2021Practical Face Reconstruction via Differentiable Ray Tracingcited by 35
- 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 34
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Modelscited by 34
28 more
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
- 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstructioncited by 27
- 2022Facial Geometric Detail Recovery via Implicit Representationcited by 27
- 2023HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Detailscited by 22
- 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shadingcited by 18
- 2022Video-driven Neural Physically-based Facial Asset for Productioncited by 17
- 2022S2F2: Self-Supervised High Fidelity Face Reconstruction from Monocular Imagecited by 17
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
- 2021Prior-Guided Multi-View 3D Head Reconstructioncited by 14
- 2022Relightable Neural Human Assets from Multi-view Gradient Illuminationscited by 11
- 2021Invertible Frowns: Video-to-Video Facial Emotion Translationcited by 6
- 2021Unsupervised High-Fidelity Facial Texture Generation and Reconstructioncited by 6
- 2023RAFaRe: Learning Robust and Accurate Non-parametric 3D Face Reconstruction from Pseudo 2D&3D Pairscited by 6
- 2022Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shapecited by 5
- 2025Facial Appearance Capture at Home with Patch-Level Reflectance Priorcited by 5
- 2021Implicit Neural Deformation for Sparse-View Face Reconstructioncited by 4
- 2022Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulationcited by 4
- 2021Joint Learning of Portrait Intrinsic Decomposition and Relightingcited by 3
- 2021Self-Supervised Robustifying Guidance for Monocular 3D Face Reconstructioncited by 3
- 2023Style Transfer for 2D Talking Head Animationcited by 3
- 2025High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approachcited by 2
- 2024Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstructioncited by 1
- 2021An Image-based Generator Architecture for Synthetic Image Refinementcited by 0
- 2021Self-supervised Re-renderable Facial Albedo Reconstruction from Single Imagecited by 0
- 2024Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinementcited by 0
- 2025Learning Contour-Guided 3D Face Reconstruction with Occlusionscited by 0
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generationcited by 0
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Datacited by 0
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data5 Jul 2026
- 2025High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approach16 Jun 2025
- 2025Facial Appearance Capture at Home with Patch-Level Reflectance Prior4 Jun 2025
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generation21 Apr 2025
- 2025Learning Contour-Guided 3D Face Reconstruction with Occlusions16 Mar 2025
- 2024Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction25 Dec 2024
- 2024URAvatar: Universal Relightable Gaussian Codec Avatars31 Oct 2024
- 2024Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement15 Apr 2024
- 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shading20 Dec 2023
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videos11 Dec 2023
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatars16 May 2023
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Models10 May 2023
28 more
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization4 May 2023
- 2023HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details20 Mar 2023
- 2023Style Transfer for 2D Talking Head Animation17 Mar 2023
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images28 Feb 2023
- 2023RAFaRe: Learning Robust and Accurate Non-parametric 3D Face Reconstruction from Pseudo 2D&3D Pairs10 Feb 2023
- 2022Relightable Neural Human Assets from Multi-view Gradient Illuminations15 Dec 2022
- 2022Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation19 Jul 2022
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguation8 May 2022
- 2022Towards Metrical Reconstruction of Human Faces13 Apr 2022
- 2022Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape9 Apr 2022
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset26 Mar 2022
- 2022Facial Geometric Detail Recovery via Implicit Representation18 Mar 2022
- 2022S2F2: Self-Supervised High Fidelity Face Reconstruction from Monocular Image15 Mar 2022
- 2022Video-driven Neural Physically-based Facial Asset for Production11 Feb 2022
- 2021Self-Supervised Robustifying Guidance for Monocular 3D Face Reconstruction29 Dec 2021
- 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANs11 Dec 2021
- 2021Implicit Neural Deformation for Sparse-View Face Reconstruction5 Dec 2021
- 2021Self-supervised Re-renderable Facial Albedo Reconstruction from Single Image16 Nov 2021
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction1 Nov 2021
- 2021Unsupervised High-Fidelity Facial Texture Generation and Reconstruction10 Oct 2021
- 2021Invertible Frowns: Video-to-Video Facial Emotion Translation16 Sep 2021
- 2021An Image-based Generator Architecture for Synthetic Image Refinement10 Aug 2021
- 2021Prior-Guided Multi-View 3D Head Reconstruction9 Jul 2021
- 2021Joint Learning of Portrait Intrinsic Decomposition and Relighting22 Jun 2021
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement21 Jun 2021
- 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction6 Jun 2021
- 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfer5 Apr 2021
- 2021Practical Face Reconstruction via Differentiable Ray Tracing13 Jan 2021
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
- 2024URAvatar: Universal Relightable Gaussian Codec Avatarscited by 43
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2021Practical Face Reconstruction via Differentiable Ray Tracingcited by 35
- 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 34
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
12 most cited of 37 All 37 (JSON)
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data5 Jul 2026
- 2025High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approach16 Jun 2025
- 2025Learning Contour-Guided 3D Face Reconstruction with Occlusions16 Mar 2025
- 2024Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction25 Dec 2024
- 2024URAvatar: Universal Relightable Gaussian Codec Avatars31 Oct 2024
- 2024Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement15 Apr 2024
- 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shading20 Dec 2023
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videos11 Dec 2023
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatars16 May 2023
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization4 May 2023
- 2023HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details20 Mar 2023
- 2023Style Transfer for 2D Talking Head Animation17 Mar 2023
12 newest of 37 All 37 (JSON)