Effective Face Frontalization in Unconstrained Images
Not on the map. Why?
Abstract (arXiv)
"Frontalization" is the process of synthesizing frontal facing views of faces appearing in single unconstrained photos. Recent reports have suggested that this process may substantially boost the performance of face recognition systems. This, by transforming the challenging problem of recognizing faces viewed from unconstrained viewpoints to the easier problem of recognizing faces in constrained, forward facing poses. Previous frontalization methods did this by attempting to approximate 3D facial shapes for each query image. We observe that 3D face shape estimation from unconstrained photos may be a harder problem than frontalization and can potentially introduce facial misalignments. Instead, we explore the simpler approach of using a single, unmodified, 3D surface as an approximation to the shape of all input faces. We show that this leads to a straightforward, efficient and easy to implement method for frontalization. More importantly, it produces aesthetic new frontal views and is surprisingly effective when used for face recognition and gender estimation.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 9; 2024: 4; 2025: 4; 2026: 1.
34 papers.
Sort:
By area:
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 20223D face reconstruction with dense landmarkscited by 70
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2021Joint Face Image Restoration and Frontalization for Recognitioncited by 18
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2021Egocentric Videoconferencingcited by 10
- 20233D Face Reconstruction: the Road to Forensicscited by 7
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networkscited by 6
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANscited by 6
- 2022Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shapecited by 5
- 2024Cascaded Dual Vision Transformer for Accurate Facial Landmark Detectioncited by 5
- 2022Expression-preserving face frontalization improves visually assisted speech processingcited by 4
22 more
- 20233D Face Reconstruction for Forensic Recognition -- A Surveycited by 4
- 2025Exploiting Multiple Representations: 3D Face Biometrics Fusion with Application to Surveillancecited by 4
- 2021Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstructioncited by 3
- 2021PAM: Pose Attention Module for Pose-Invariant Face Recognitioncited by 3
- 2022Pose Attention-Guided Profile-to-Frontal Face Recognitioncited by 3
- 2023A Study on the Impact of Face Image Quality on Face Recognition in the Wildcited by 3
- 20232D Image head pose estimation via latent space regression under occlusion settingscited by 3
- 2024Exploring 3D Face Reconstruction and Fusion Methods for Face Verification: A Case-Study in Video Surveillancecited by 3
- 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfercited by 3
- 2021An Efficient Multitask Neural Network for Face Alignment, Head Pose Estimation and Face Trackingcited by 2
- 2024Fiducial Focus Augmentation for Facial Landmark Detectioncited by 2
- 2021Learning to Deblur and Rotate Motion-Blurred Facescited by 1
- 20252D-3D Attention and Entropy for Pose Robust 2D Facial Recognitioncited by 1
- 2021Active Face Frontalization using Commodity Unmanned Aerial Vehiclescited by 0
- 2021Exploring Biases and Prejudice of Facial Synthesis via Semantic Latent Spacecited by 0
- 2023Generating Animatable 3D Cartoon Faces from Single Portraitscited by 0
- 2023Facial Landmark Detection Evaluation on MOBIO Databasecited by 0
- 2023Face Image Quality Enhancement Study for Face Recognitioncited by 0
- 2023Illumination and Shadows in Head Rotation: experiments with Denoising Diffusion Modelscited by 0
- 2024Direct May Not Be the Best: An Incremental Evolution View of Pose Generationcited by 0
- 2025Towards Large-Scale Pose-Invariant Face Recognition Using Face Defrontalizationcited by 0
- 2025Does Head Pose Correction Improve Biometric Facial Recognition?cited by 0
- 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer8 Jan 2026
- 2025Does Head Pose Correction Improve Biometric Facial Recognition?2 Dec 2025
- 2025Towards Large-Scale Pose-Invariant Face Recognition Using Face Defrontalization4 Jun 2025
- 20252D-3D Attention and Entropy for Pose Robust 2D Facial Recognition14 May 2025
- 2025Exploiting Multiple Representations: 3D Face Biometrics Fusion with Application to Surveillance26 Apr 2025
- 2024Cascaded Dual Vision Transformer for Accurate Facial Landmark Detection8 Nov 2024
- 2024Exploring 3D Face Reconstruction and Fusion Methods for Face Verification: A Case-Study in Video Surveillance16 Sep 2024
- 2024Direct May Not Be the Best: An Incremental Evolution View of Pose Generation12 Apr 2024
- 2024Fiducial Focus Augmentation for Facial Landmark Detection23 Feb 2024
- 20232D Image head pose estimation via latent space regression under occlusion settings10 Nov 2023
- 20233D Face Reconstruction: the Road to Forensics20 Sep 2023
- 2023Illumination and Shadows in Head Rotation: experiments with Denoising Diffusion Models11 Aug 2023
22 more
- 2023Face Image Quality Enhancement Study for Face Recognition8 Jul 2023
- 2023Facial Landmark Detection Evaluation on MOBIO Database6 Jul 2023
- 2023A Study on the Impact of Face Image Quality on Face Recognition in the Wild5 Jul 2023
- 2023Generating Animatable 3D Cartoon Faces from Single Portraits4 Jul 2023
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs23 Feb 2023
- 20233D Face Reconstruction for Forensic Recognition -- A Survey3 Feb 2023
- 2022GAN-based Facial Attribute Manipulation23 Oct 2022
- 2022Pose Attention-Guided Profile-to-Frontal Face Recognition15 Sep 2022
- 2022Realistic One-shot Mesh-based Head Avatars16 Jun 2022
- 2022Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape9 Apr 2022
- 2022Expression-preserving face frontalization improves visually assisted speech processing6 Apr 2022
- 20223D face reconstruction with dense landmarks6 Apr 2022
- 2021Learning to Deblur and Rotate Motion-Blurred Faces14 Dec 2021
- 2021PAM: Pose Attention Module for Pose-Invariant Face Recognition23 Nov 2021
- 2021Facial Landmark Points Detection Using Knowledge Distillation-Based Neural Networks13 Nov 2021
- 2021Exploring Biases and Prejudice of Facial Synthesis via Semantic Latent Space23 Aug 2021
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Papers6 Aug 2021
- 2021Egocentric Videoconferencing7 Jul 2021
- 2021Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction14 Jun 2021
- 2021Joint Face Image Restoration and Frontalization for Recognition12 May 2021
- 2021An Efficient Multitask Neural Network for Face Alignment, Head Pose Estimation and Face Tracking13 Mar 2021
- 2021Active Face Frontalization using Commodity Unmanned Aerial Vehicles17 Feb 2021
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 20223D face reconstruction with dense landmarkscited by 70
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2021Joint Face Image Restoration and Frontalization for Recognitioncited by 18
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2021Egocentric Videoconferencingcited by 10
- 20233D Face Reconstruction: the Road to Forensicscited by 7
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANscited by 6
- 2022Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shapecited by 5
- 2024Cascaded Dual Vision Transformer for Accurate Facial Landmark Detectioncited by 5
- 2022Expression-preserving face frontalization improves visually assisted speech processingcited by 4
- 20233D Face Reconstruction for Forensic Recognition -- A Surveycited by 4
12 most cited of 32 All 32 (JSON)
- 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer8 Jan 2026
- 2025Does Head Pose Correction Improve Biometric Facial Recognition?2 Dec 2025
- 2025Towards Large-Scale Pose-Invariant Face Recognition Using Face Defrontalization4 Jun 2025
- 20252D-3D Attention and Entropy for Pose Robust 2D Facial Recognition14 May 2025
- 2025Exploiting Multiple Representations: 3D Face Biometrics Fusion with Application to Surveillance26 Apr 2025
- 2024Cascaded Dual Vision Transformer for Accurate Facial Landmark Detection8 Nov 2024
- 2024Exploring 3D Face Reconstruction and Fusion Methods for Face Verification: A Case-Study in Video Surveillance16 Sep 2024
- 2024Direct May Not Be the Best: An Incremental Evolution View of Pose Generation12 Apr 2024
- 2024Fiducial Focus Augmentation for Facial Landmark Detection23 Feb 2024
- 20232D Image head pose estimation via latent space regression under occlusion settings10 Nov 2023
- 20233D Face Reconstruction: the Road to Forensics20 Sep 2023
- 2023Face Image Quality Enhancement Study for Face Recognition8 Jul 2023
12 newest of 32 All 32 (JSON)