Fine-Grained Head Pose Estimation Without Keypoints
Not on the map. Why?
Abstract (arXiv)
Estimating the head pose of a person is a crucial problem that has a large amount of applications such as aiding in gaze estimation, modeling attention, fitting 3D models to video and performing face alignment. Traditionally head pose is computed by estimating some keypoints from the target face and solving the 2D to 3D correspondence problem with a mean human head model. We argue that this is a fragile method because it relies entirely on landmark detection performance, the extraneous head model and an ad-hoc fitting step. We present an elegant and robust way to determine pose by training a multi-loss convolutional neural network on 300W-LP, a large synthetically expanded dataset, to predict intrinsic Euler angles (yaw, pitch and roll) directly from image intensities through joint binned pose classification and regression. We present empirical tests on common in-the-wild pose benchmark datasets which show state-of-the-art results. Additionally we test our method on a dataset usually used for pose estimation using depth and start to close the gap with state-of-the-art depth pose methods. We open-source our training and testing code as well as release our pre-trained models.
Key facts. Cited by 163 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 35; 2022: 38; 2023: 26; 2024: 30; 2025: 21; 2026: 12.
163 papers.
Sort:
By area:
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
- 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Modelscited by 60
- 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
- 2022High-resolution Face Swapping via Latent Semantics Disentanglementcited by 57
38 more
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
- 2022Region-Aware Face Swappingcited by 45
- 2022OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regressioncited by 44
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2022FSGANv2: Improved Subject Agnostic Face Swapping and Reenactmentcited by 33
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2021Multimodal Engagement Analysis from Facial Videos in the Classroomcited by 27
- 2021Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometrycited by 27
- 2021MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulationcited by 24
- 20233D-aware Conditional Image Synthesiscited by 24
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understandingcited by 24
- 2022Multi-task head pose estimation in-the-wildcited by 23
- 2022Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal Regressioncited by 23
- 2024CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generationcited by 22
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Textcited by 21
- 2023Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimationcited by 20
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priorscited by 20
- 2024Face Anonymization Made Simplecited by 18
- 2024Omni-ID: Holistic Identity Representation Designed for Generative Taskscited by 18
- 2022Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GANcited by 16
- 2023MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Modelcited by 16
- 2024ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performercited by 16
- 2021Scaling-up Disentanglement for Image Translationcited by 15
- 2024Adaptive Super Resolution For One-Shot Talking-Head Generationcited by 15
- 2024On the representation and methodology for wide and short range head pose estimationcited by 12
- 2023Face Transformer: Towards High Fidelity and Accurate Face Swappingcited by 11
- 2023Bias and Diversity in Synthetic-based Face Recognitioncited by 11
- 2021ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimationcited by 10
- 2021Simulated Adversarial Testing of Face Recognition Modelscited by 10
- 2021Egocentric Videoconferencingcited by 10
- 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
- 2024Biometrics and Behavior Analysis for Detecting Distractions in e-Learningcited by 10
- 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertaintycited by 9
- 2022Towards 3D Face Reconstruction in Perspective Projection: Estimating 6DoF Face Pose from Monocular Imagecited by 9
- 2022What's in a Decade? Transforming Faces Through Timecited by 9
50 most cited of 163 All 163 (JSON)
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Lightweight Pedestrian Head-Orientation Recognition Network for Safe Pedestrian-Vehicle Interaction21 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Coordinate Singularities Break Conformal Coverage for Gaze and Head Pose29 Jun 2026
- 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment21 Apr 2026
- 2026Generative Anonymization in Event Streams14 Apr 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026EgoAdapt: Enhancing Robustness in Egocentric Interactive Speaker Detection Under Missing Modalities18 Mar 2026
- 2026GazeMoE: Perception of Gaze Target with Mixture-of-Experts6 Mar 2026
- 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation4 Mar 2026
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbation21 Feb 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
38 more
- 2025Reverse Personalization28 Dec 2025
- 2025Preserving Source Video Realism: High-Fidelity Face Swapping for Cinematic Quality8 Dec 2025
- 2025Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks4 Nov 2025
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization28 Oct 2025
- 2025Revising Second Order Terms in Deep Animation Video Coding27 Oct 2025
- 2025Preventing Shortcuts in Adapter Training via Providing the Shortcuts23 Oct 2025
- 2025KSDiff: Keyframe-Augmented Speech-Aware Dual-Path Diffusion for Facial Animation24 Sep 2025
- 2025Multi-view Gaze Target Estimation7 Aug 2025
- 2025NLML-HPE: Head Pose Estimation with Limited Data via Manifold Learning24 Jul 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025Pose-invariant face recognition via feature-space pose frontalization22 May 2025
- 2025MorphGuard: Morph Specific Margin Loss for Enhancing Robustness to Face Morphing Attacks15 May 2025
- 2025Test-Time Augmentation for Pose-invariant Face Recognition14 May 2025
- 2025GADS: A Super Lightweight Model for Head Pose Estimation22 Apr 2025
- 2025Pose and Facial Expression Transfer by using StyleGAN17 Apr 2025
- 2025Controllable Expressive 3D Facial Animation via Diffusion in a Unified Multimodal Space14 Apr 2025
- 2025Unlock Pose Diversity: Accurate and Efficient Implicit Keypoint-based Spatiotemporal Diffusion for Audio-driven Talking Portrait17 Mar 2025
- 2025NullFace: Training-Free Localized Face Anonymization11 Mar 2025
- 2025Zero-Shot Head Swapping in Real-World Scenarios2 Mar 2025
- 2025SyncAnimation: A Real-Time End-to-End Framework for Audio-Driven Human Pose and Talking Head Animation24 Jan 2025
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understanding17 Jan 2025
- 2024Omni-ID: Holistic Identity Representation Designed for Generative Tasks12 Dec 2024
- 2024Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images3 Dec 2024
- 2024CLERF: Contrastive LEaRning for Full Range Head Pose Estimation3 Dec 2024
- 2024Face De-identification: State-of-the-art Methods and Comparative Studies15 Nov 2024
- 2024Face Anonymization Made Simple1 Nov 2024
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors18 Aug 2024
- 2024FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model18 Aug 2024
- 2024ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer6 Aug 2024
- 2024LDFaceNet: Latent Diffusion-based Network for High-Fidelity Deepfake Generation4 Aug 2024
- 2024Full-range Head Pose Geometric Data Augmentations2 Aug 2024
- 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignment19 Jul 2024
- 2024On the power of data augmentation for head pose estimation7 Jul 2024
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task4 Jun 2024
- 2024Rank-based No-reference Quality Assessment for Face Swapping4 Jun 2024
- 2024Gaitor: Learning a Unified Representation Across Gaits for Real-World Quadruped Locomotion29 May 2024
- 2024Biometrics and Behavior Analysis for Detecting Distractions in e-Learning24 May 2024
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Text16 May 2024
50 newest of 163 All 163 (JSON)
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Modelscited by 60
- 2023MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Modelcited by 16
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformercited by 9
- 2024FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Modelcited by 3
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbationcited by 2
- 2024LDFaceNet: Latent Diffusion-based Network for High-Fidelity Deepfake Generationcited by 1
- 2025KSDiff: Keyframe-Augmented Speech-Aware Dual-Path Diffusion for Facial Animationcited by 1
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymizationcited by 1
- 2025Reverse Personalizationcited by 1
- 2026IDperturb: Enhancing Variation in Synthetic Face Generation via Angular Perturbation21 Feb 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
- 2025Reverse Personalization28 Dec 2025
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization28 Oct 2025
- 2025KSDiff: Keyframe-Augmented Speech-Aware Dual-Path Diffusion for Facial Animation24 Sep 2025
- 2024FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model18 Aug 2024
- 2024LDFaceNet: Latent Diffusion-based Network for High-Fidelity Deepfake Generation4 Aug 2024
- 2023MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Model31 Aug 2023
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications30 Aug 2023
- 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models20 Mar 2023
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec 2022
- 2021Boosting of Head Pose Estimation by Knowledge Distillation20 Aug 2021
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
- 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
- 2022High-resolution Face Swapping via Latent Semantics Disentanglementcited by 57
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
- 2022Region-Aware Face Swappingcited by 45
12 most cited of 146 All 146 (JSON)
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Lightweight Pedestrian Head-Orientation Recognition Network for Safe Pedestrian-Vehicle Interaction21 Sep 2026
- 2026Coordinate Singularities Break Conformal Coverage for Gaze and Head Pose29 Jun 2026
- 2026PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment21 Apr 2026
- 2026Generative Anonymization in Event Streams14 Apr 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026EgoAdapt: Enhancing Robustness in Egocentric Interactive Speaker Detection Under Missing Modalities18 Mar 2026
- 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation4 Mar 2026
- 2025Preserving Source Video Realism: High-Fidelity Face Swapping for Cinematic Quality8 Dec 2025
- 2025Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks4 Nov 2025
- 2025Revising Second Order Terms in Deep Animation Video Coding27 Oct 2025
- 2025Preventing Shortcuts in Adapter Training via Providing the Shortcuts23 Oct 2025
12 newest of 146 All 146 (JSON)