FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and propose a novel algorithm that is able to predict elaborate riggable 3D face models from a single image input. FaceScape dataset provides 18,760 textured 3D faces, captured from 938 subjects and each with 20 specific expressions. The 3D models contain the pore-level facial geometry that is also processed to be topologically uniformed. These fine 3D facial models can be represented as a 3D morphable model for rough shapes and displacement maps for detailed geometry. Taking advantage of the large-scale and high-accuracy dataset, a novel algorithm is further proposed to learn the expression-specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different than the previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. The unprecedented dataset and code will be released to public for research purpose.
Key facts. Cited by 196 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 35; 2023: 47; 2024: 35; 2025: 32; 2026: 19.
196 papers.
Sort:
By area:
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
- 2022Learning Neural Parametric Head Modelscited by 73
38 more
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023Inserting Anybody in Diffusion Models via Celeb Basiscited by 63
- 2021Geometry-Consistent Neural Shape Representation with Implicit Displacement Fieldscited by 60
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
- 2022Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videoscited by 50
- 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
- 2021Neural Video Portrait Relighting in Real-time via Consistency Modelingcited by 46
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
- 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
- 2022FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstructioncited by 39
- 2021NeLF: Neural Light-transport Field for Portrait View Synthesis and Relightingcited by 38
- 2022FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression Editingcited by 38
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
- 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Fieldcited by 37
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
- 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 34
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
- 2022REALY: Rethinking the Evaluation of 3D Face Reconstructioncited by 32
- 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 32
- 2021Riggable 3D Face Reconstruction via In-Network Optimizationcited by 31
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2023FaceXHuBERT: Text-less Speech-driven E(X)pressive 3D Facial Animation Synthesis Using Self-Supervised Speech Representation Learningcited by 29
- 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
- 2022Facial Geometric Detail Recovery via Implicit Representationcited by 27
- 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Modelscited by 27
- 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
- 2023HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Detailscited by 22
50 most cited of 196 All 196 (JSON)
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026KoUniTalk: A Lightweight Articulation-Centered Korean-English 3D Talking Face Benchmark17 Sep 2026
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo31 May 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026TOPOS: High-Fidelity and Efficient Industry-Grade 3D Head Generation14 May 2026
- 2026High-Fidelity Single-Image Head Modeling with Industry-Grade Topology6 May 2026
- 2026Profile-Specific 3DMM Regression from a Single Lateral Face Image3 May 2026
- 2026Registration-Free Learnable Multi-View Capture of Faces in Dense Semantic Correspondence2 May 2026
- 2026One-shot Compositional 3D Head Avatars with Deformable Hair16 Apr 2026
38 more
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2026High-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressions16 Mar 2026
- 2026SARS: A Novel Face and Body Shape and Appearance Aware 3D Reconstruction System extends Morphable Models10 Feb 2026
- 2026Spherical Geometry Diffusion: Generating High-quality 3D Face Geometry via Sphere-anchored Representations19 Jan 2026
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Images12 Jan 2026
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texture18 Dec 2025
- 2025SRAM: Shape-Realism Alignment Metric for No Reference 3D Shape Evaluation1 Dec 2025
- 2025Bringing Your Portrait to 3D Presence27 Nov 2025
- 2025FIELDS: Face reconstruction with accurate Inference of Expression using Learning with Direct Supervision26 Nov 2025
- 2025VGGTFace: Topologically Consistent Facial Geometry Reconstruction in the Wild25 Nov 2025
- 2025GFT-GCN: Privacy-Preserving 3D Face Mesh Recognition with Spectral Diffusion25 Nov 2025
- 2025MHR: Momentum Human Rig19 Nov 2025
- 2025Hi-Reco: High-Fidelity Real-Time Conversational Digital Humans16 Nov 2025
- 2025Efficient Label Refinement for Face Parsing Under Extreme Poses Using 3D Gaussian Splatting9 Oct 2025
- 2025PAL-Net: A Point-Wise CNN with Patch-Attention for 3D Facial Landmark Localization1 Oct 2025
- 2025BFSM: 3D Bidirectional Face-Skull Morphable Model29 Sep 2025
- 2025Hierarchical MLANet: Multi-level Attention for 3D Face Reconstruction From Single Images12 Sep 2025
- 2025GRMM: Real-Time High-Fidelity Gaussian Morphable Head Model with Learned Residuals2 Sep 2025
- 2025FastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Poses25 Aug 2025
- 2025ATLAS: Decoupling Skeletal and Shape Parameters for Expressive Parametric Human Modeling21 Aug 2025
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fields8 Aug 2025
- 2025HairCUP: Hair Compositional Universal Prior for 3D Gaussian Avatars25 Jul 2025
- 2025NLML-HPE: Head Pose Estimation with Limited Data via Manifold Learning24 Jul 2025
- 2025Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autism30 May 2025
- 20253D Face Reconstruction Error Decomposed: A Modular Benchmark for Fair and Fast Method Evaluation23 May 2025
- 20252D-3D Attention and Entropy for Pose Robust 2D Facial Recognition14 May 2025
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generation21 Apr 2025
- 2025EmoHead: Emotional Talking Head via Manipulating Semantic Expression Parameters25 Mar 2025
- 2025FreeUV: Ground-Truth-Free Realistic Facial UV Texture Recovery via Cross-Assembly Inference Strategy21 Mar 2025
- 2025Electromyography-Informed Facial Expression Reconstruction for Physiological-Based Synthesis and Analysis12 Mar 2025
- 2025GenVDM: Generating Vector Displacement Maps From a Single Image1 Mar 2025
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Video27 Feb 2025
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatars27 Feb 2025
- 2025TEASER: Token Enhanced Spatial Modeling for Expressions Reconstruction16 Feb 2025
- 2025Pippo: High-Resolution Multi-View Humans from a Single Image11 Feb 2025
50 newest of 196 All 196 (JSON)
- 2023Inserting Anybody in Diffusion Models via Celeb Basiscited by 63
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2021Neural Video Portrait Relighting in Real-time via Consistency Modelingcited by 46
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
- 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Modelscited by 27
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2024UVMap-ID: A Controllable and Personalized UV Map Generative Modelcited by 7
- 2023FitDiff: Robust monocular 3D facial shape and reflectance estimation using Diffusion Modelscited by 5
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generationcited by 0
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photocited by 0
12 most cited of 13 All 13 (JSON)
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo31 May 2026
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generation21 Apr 2025
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models16 Dec 2024
- 2024Diffusion Models in 3D Vision: A Survey7 Oct 2024
- 2024A Survey on Personalized Content Synthesis with Diffusion Models9 May 2024
- 2024UVMap-ID: A Controllable and Personalized UV Map Generative Model22 Apr 2024
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation9 Jan 2024
- 2023FitDiff: Robust monocular 3D facial shape and reflectance estimation using Diffusion Models7 Dec 2023
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation16 Jun 2023
- 2023Inserting Anybody in Diffusion Models via Celeb Basis1 Jun 2023
- 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Models14 Sep 2022
12 newest of 13 All 13 (JSON)
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
- 2022Learning Neural Parametric Head Modelscited by 73
12 most cited of 183 All 183 (JSON)
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026KoUniTalk: A Lightweight Articulation-Centered Korean-English 3D Talking Face Benchmark17 Sep 2026
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation24 May 2026
- 2026TOPOS: High-Fidelity and Efficient Industry-Grade 3D Head Generation14 May 2026
- 2026High-Fidelity Single-Image Head Modeling with Industry-Grade Topology6 May 2026
- 2026Profile-Specific 3DMM Regression from a Single Lateral Face Image3 May 2026
- 2026Registration-Free Learnable Multi-View Capture of Faces in Dense Semantic Correspondence2 May 2026
- 2026One-shot Compositional 3D Head Avatars with Deformable Hair16 Apr 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
12 newest of 183 All 183 (JSON)