Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set
Not on the map. Why?
Cited by 49 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth 3D face shapes are scarce. In this paper, we propose a novel deep 3D face reconstruction approach that 1) leverages a robust, hybrid loss function for weakly-supervised learning which takes into account both low-level and perception-level information for supervision, and 2) performs multi-image face reconstruction by exploiting complementary information from different images for shape aggregation. Our method is fast, accurate, and robust to occlusion and large pose. We provide comprehensive experiments on three datasets, systematically comparing our method with fifteen recent methods and demonstrating its state-of-the-art performance.
Key facts. Cited by 482 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 50; 2022: 73; 2023: 122; 2024: 120; 2025: 72; 2026: 45.
482 papers.
Sort:
By area:
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 235
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
38 more
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2021SynFace: Face Recognition with Synthetic Datacited by 106
- 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2023StyleTalk: One-shot Talking Head Generation with Controllable Speaking Stylescited by 92
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2021FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learningcited by 90
- 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 2022DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Renderingcited by 80
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
- 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 72
- 2024Sonic: Shifting Focus to Global Audio Perception in Portrait Animationcited by 72
- 20223D face reconstruction with dense landmarkscited by 70
- 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
- 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
50 most cited of 482 All 482 (JSON)
- 2026CatPortrait: Taming Video Generative Models for Portrait Animation via In-context Conditioning10 Oct 2026
- 2026Learning Semantic Inpainting for Animatable Gaussian Head Avatars29 Sep 2026
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026Decoupled Self-Forcing Distillation for Streaming Talking Head Generation9 Sep 2026
- 2026BEACON: Behavior and Appearance Control for Subject-Specific Video Generation7 Sep 2026
- 2026FaceSnap: Real-Time Personalized Lightstage Facial Performance Capture31 Aug 2026
- 2026RealDenseFace: Real-time Monocular 3D Face Reconstruction from Dense UV-space Priors10 Aug 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026ViDS: Video Diffusion Shader using 3D Face Tracking27 Jul 2026
- 2026GRAPE: Graduated Routing for Articulated Portrait mesh Estimation26 Jul 2026
- 2026UVFaceFusion: Fast Multi-view Topologically Consistent Face Reconstruction in the Wild via UV-space Neural Fusion21 Jul 2026
38 more
- 2026Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation8 Jul 2026
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data5 Jul 2026
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusion26 Jun 2026
- 2026OMGTex: One-stage Multi-style Facial Texture Reconstruction without Geometry Guidance25 May 2026
- 2026SplitAvatar: One-shot Head Avatar with Autoregressive Gaussian Splitting25 May 2026
- 2026MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation8 May 2026
- 20263D Human Face Reconstruction with 3DMM face model from RGB image5 May 2026
- 2026Profile-Specific 3DMM Regression from a Single Lateral Face Image3 May 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
- 2026Chatting about Upper-Body Expressive Human Pose and Shape Estimation20 Apr 2026
- 2026One-shot Compositional 3D Head Avatars with Deformable Hair16 Apr 2026
- 2026PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction15 Apr 2026
- 2026Representing 3D Faces with Learnable B-Spline Volumes14 Apr 2026
- 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarization6 Apr 2026
- 2026FaceParts: Segmentation and Editing of Gaussian Splatting25 Mar 2026
- 2026ECHO: Towards Emotionally Appropriate and Contextually Aware Interactive Head Generation18 Mar 2026
- 2026High-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressions16 Mar 2026
- 2026Revisiting an Old Perspective Projection for Monocular 3D Morphable Models Regression5 Mar 2026
- 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation4 Mar 2026
- 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation4 Mar 2026
- 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar2 Mar 2026
- 2026You Only Need One Stage: Novel-View Synthesis From A Single Blind Face Image1 Mar 2026
- 2026EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generation14 Feb 2026
- 2026VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping8 Feb 2026
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping21 Jan 2026
- 2026UIKA: Fast Universal Head Avatar from Pose-Free Images12 Jan 2026
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splatting9 Jan 2026
- 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer8 Jan 2026
- 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splatting5 Jan 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
- 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation2 Jan 2026
- 2025Reverse Personalization28 Dec 2025
- 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformation19 Dec 2025
- 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texture18 Dec 2025
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision17 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
50 newest of 482 All 482 (JSON)
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 235
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2022Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priorscited by 55
- 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Modelscited by 34
- 2023DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesiscited by 26
- 2024TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Modelcited by 19
- 2024Face2Diffusion for Fast and Editable Face Personalizationcited by 17
- 2023MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Modelcited by 16
12 most cited of 49 All 49 (JSON)
- 2026Decoupled Self-Forcing Distillation for Streaming Talking Head Generation9 Sep 2026
- 2026ViDS: Video Diffusion Shader using 3D Face Tracking27 Jul 2026
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation4 Mar 2026
- 2026VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping8 Feb 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
- 2025Reverse Personalization28 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
- 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generation27 Nov 2025
- 2025Input-Aware Sparse Attention for Real-Time Co-Speech Video Generation2 Oct 2025
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model10 Jul 2025
12 newest of 49 All 49 (JSON)
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 187
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
12 most cited of 431 All 431 (JSON)
- 2026CatPortrait: Taming Video Generative Models for Portrait Animation via In-context Conditioning10 Oct 2026
- 2026Learning Semantic Inpainting for Animatable Gaussian Head Avatars29 Sep 2026
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses21 Sep 2026
- 2026BEACON: Behavior and Appearance Control for Subject-Specific Video Generation7 Sep 2026
- 2026FaceSnap: Real-Time Personalized Lightstage Facial Performance Capture31 Aug 2026
- 2026RealDenseFace: Real-time Monocular 3D Face Reconstruction from Dense UV-space Priors10 Aug 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026GRAPE: Graduated Routing for Articulated Portrait mesh Estimation26 Jul 2026
- 2026UVFaceFusion: Fast Multi-view Topologically Consistent Face Reconstruction in the Wild via UV-space Neural Fusion21 Jul 2026
- 2026Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation8 Jul 2026
- 2026Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data5 Jul 2026
12 newest of 431 All 431 (JSON)